00000100:00100000:3.0F:1780809569.610942:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0F:1780809569.610990:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334899328 00000100:00100000:0.0:1780809569.611006:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334899328 00000100:00100000:0.0:1780809569.611049:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7352 00000100:00100000:0.0:1780809569.611057:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:141419:x1867312334899328:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809569.611075:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809569.611102:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e14 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611152:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611161:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611169:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611177:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611184:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611191:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611282:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611290:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2720 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e06 expref: 33 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611304:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611329:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2720 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e06 expref: 33 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.611338:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2720 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e06 expref: 33 pid: 77628 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809569.611347:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd707480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338730496:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809569.611407:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadfc905480 going to sleep for 11 seconds 00000100:00100000:0.0:1780809569.612196:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd707480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338730496:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809569.612212:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809569.612234:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809569.612260:0:80175:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334899584 00000100:00100000:0.0:1780809569.612264:0:80175:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334899584 00000100:00100000:1.0F:1780809569.612329:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1686 00000100:00100000:1.0:1780809569.612347:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:89645:x1867312334899584:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809569.612496:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:89645:x1867312334899584:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 152us (262us total) trans 55834578399 rc 0/0 00000100:00100000:1.0:1780809569.612501:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1686 00000100:00100000:1.0:1780809569.613184:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809569.613232:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334899712 00000100:00100000:3.0:1780809569.613237:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334899712 00010000:00010000:3.0:1780809569.613259:0:77613:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2720 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e06 expref: 35 pid: 77628 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809569.613284:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 479 00000100:00100000:3.0:1780809569.613292:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc7106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2391:x1867312334899712:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780809569.613301:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780809569.613307:0:77613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2720 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e06 expref: 35 pid: 77628 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.613318:0:77613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2720 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e06 expref: 35 pid: 77628 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.613333:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2720 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e06 expref: 35 pid: 77628 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.613357:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809569.613361:0:77613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.613369:0:77613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.613375:0:77613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.613393:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809569.613408:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613416:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809569.613429:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc7106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2391:x1867312334899712:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809569.613436:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 479 00000004:00200000:0.0:1780809569.613440:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809569.613444:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809569.613458:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613482:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613491:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613498:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613506:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613512:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809569.613516:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613523:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613567:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809569.613570:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809569.613573:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613577:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613615:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613622:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613635:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613642:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809569.613646:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613652:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613660:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:0.0:1780809569.613661:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809569.613664:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613667:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f275f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613688:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 34 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613699:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.613707:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809569.613709:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809569.613711:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cea00, rc 0) 00000100:00100000:0.0:1780809569.613740:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:141419:x1867312334899328:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2684us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809569.613752:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7352 00000100:00100000:1.0:1780809569.614958:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809569.614989:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334899968 00000100:00100000:3.0:1780809569.614993:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334899968 00000100:00100000:3.0:1780809569.615021:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7353 00000100:00100000:3.0:1780809569.615029:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:141419:x1867312334899968:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809569.615041:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809569.615051:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f276d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e1b expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.615121:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.615132:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 34 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.615140:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.615155:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 34 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.615163:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 34 pid: 79214 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809569.615170:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338730624:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809569.615204:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf5506780 going to sleep for 11 seconds 00000100:00100000:3.0:1780809569.615779:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338730624:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809569.615794:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809569.615984:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809569.616004:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334900096 00000100:00100000:0.0:1780809569.616031:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334900096 00010000:00010000:0.0:1780809569.616043:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 35 pid: 79214 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809569.616063:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 480 00000100:00100000:0.0:1780809569.616068:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2393:x1867312334900096:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809569.616074:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809569.616088:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 35 pid: 79214 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.616097:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 35 pid: 79214 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.616106:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2766 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e14 expref: 35 pid: 79214 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.616114:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809569.616117:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.616121:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.616125:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.616146:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809569.616167:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2393:x1867312334900096:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 98us (182us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809569.616168:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809569.616177:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 480 00010000:00010000:3.0:1780809569.616182:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809569.616194:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809569.616273:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f276d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 35 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.616288:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 34 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.616295:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809569.616298:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809569.616301:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809569.616335:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:141419:x1867312334899968:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1306us (1376us total) trans 55834578400 rc 0/0 00000100:00100000:3.0:1780809569.616342:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7353 00000100:00100000:3.0:1780809569.651729:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338730752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780809569.651800:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809569.651857:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338730752 00000100:00100000:1.0:1780809569.651872:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338730752 00000100:00100000:1.0:1780809569.651956:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1780809569.651971:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338730752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780809569.652026:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:1.0:1780809569.652132:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338730752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809569.652143:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1780809569.652768:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338730752:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1780809569.662746:0:8788:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 55834575018 is committed 00000100:00100000:1.0:1780809569.713118:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809569.713195:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334900352 00000100:00100000:0.0:1780809569.713209:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334900352 00000100:00100000:0.0:1780809569.713271:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7354 00000100:00100000:0.0:1780809569.713282:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:141426:x1867312334900352:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809569.713306:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809569.713326:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e22 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713389:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713403:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713414:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713425:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713431:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713437:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713564:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2797 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713580:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2797 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713612:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2797 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809569.713623:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809569.713711:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713720:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713727:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713734:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cee00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809569.713738:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713746:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713758:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809569.713761:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809569.713766:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713783:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713801:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713808:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713814:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713819:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809569.713822:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713828:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713836:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:0.0:1780809569.713838:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809569.713842:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713847:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2790 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713879:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e22 expref: 37 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713905:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2797 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e22 expref: 36 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.713913:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809569.713915:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809569.713917:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce000, rc 0) 00000100:00100000:0.0:1780809569.713983:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:141426:x1867312334900352:12345-192.168.203.33@tcp:101:dd.0 Request processed in 704us (875us total) trans 55834578401 rc 0/0 00000100:00100000:0.0:1780809569.713992:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7354 00000100:00100000:1.0:1780809569.715104:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809569.715159:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334900480 00000100:00100000:0.0:1780809569.715166:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334900480 00000100:00100000:0.0:1780809569.715220:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2071 00000100:00100000:0.0:1780809569.715230:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2392:x1867312334900480:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809569.715243:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809569.715256:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2797 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e22 expref: 36 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809569.715270:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809569.715274:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809569.715303:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2392:x1867312334900480:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809569.715308:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2071 00000100:00100000:1.0:1780809569.743247:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809569.743308:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334900736 00000100:00100000:3.0:1780809569.743317:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334900736 00000100:00100000:3.0:1780809569.743364:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7355 00000100:00100000:3.0:1780809569.743372:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:141432:x1867312334900736:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809569.743390:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809569.743404:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f27a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e29 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743458:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743469:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743477:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743484:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743488:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743492:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743583:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f27ba lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743612:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f27ba lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743618:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f27ba lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809569.743633:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809569.743700:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743705:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743709:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743712:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809569.743715:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743719:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743727:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809569.743729:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809569.743732:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743735:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743744:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743748:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743760:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743763:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809569.743764:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743768:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743775:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:3.0:1780809569.743777:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809569.743780:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743785:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743817:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f27a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e29 expref: 38 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743829:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f27ba lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e29 expref: 37 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.743836:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809569.743838:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809569.743841:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809569.743889:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:141432:x1867312334900736:12345-192.168.203.33@tcp:101:dd.0 Request processed in 518us (651us total) trans 55834578402 rc 0/0 00000100:00100000:3.0:1780809569.743902:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7355 00000100:00100000:1.0:1780809569.744926:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809569.744963:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334900864 00000100:00100000:3.0:1780809569.744968:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334900864 00000100:00100000:3.0:1780809569.745000:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2072 00000100:00100000:3.0:1780809569.745007:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2391:x1867312334900864:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780809569.745015:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780809569.745024:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f27ba lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e29 expref: 37 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809569.745032:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809569.745034:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809569.745058:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2391:x1867312334900864:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809569.745066:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2072 00000100:00100000:1.0:1780809569.745114:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809569.745144:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334901120 00000100:00100000:3.0:1780809569.745149:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334901120 00000100:00100000:3.0:1780809569.745178:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1687 00000100:00100000:3.0:1780809569.745184:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:141432:x1867312334901120:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809569.745274:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:141432:x1867312334901120:12345-192.168.203.33@tcp:35:dd.0 Request processed in 90us (161us total) trans 55834578403 rc 0/0 00000100:00100000:3.0:1780809569.745279:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1687 00010000:00010000:0.0:1780809569.843716:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809570.103083:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.103135:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334901376 00000100:00100000:0.0:1780809570.103143:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334901376 00000100:00080000:3.0:1780809570.103219:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809570.103225:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7356 00000100:00100000:0.0:1780809570.103238:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:141439:x1867312334901376:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809570.103260:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809570.103279:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f27c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e30 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103334:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103345:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103353:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103359:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103363:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103367:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103461:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f27dd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103467:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f27dd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103471:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f27dd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809570.103485:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809570.103555:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103560:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103564:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103567:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809570.103570:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103574:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103582:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809570.103584:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809570.103609:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103613:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f27cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103630:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103635:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103651:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103657:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809570.103660:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103667:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103674:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:0.0:1780809570.103676:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809570.103678:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103682:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f27d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103708:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f27c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e30 expref: 40 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103721:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f27dd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e30 expref: 39 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.103728:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809570.103730:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809570.103732:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cee00, rc 0) 00000100:00100000:0.0:1780809570.103798:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:141439:x1867312334901376:12345-192.168.203.33@tcp:101:dd.0 Request processed in 555us (724us total) trans 55834578404 rc 0/0 00000100:00100000:0.0:1780809570.103819:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7356 00000100:00100000:1.0:1780809570.104899:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809570.104920:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.104937:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334901504 00000100:00100000:0.0:1780809570.104944:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334901504 00000100:00100000:3.0:1780809570.104966:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334901760 00000100:00100000:3.0:1780809570.104971:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334901760 00000100:00100000:0.0:1780809570.104994:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2073 00000100:00100000:3.0:1780809570.105009:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1688 00000100:00100000:0.0:1780809570.105016:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2394:x1867312334901504:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809570.105019:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:141439:x1867312334901760:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:0.0:1780809570.105031:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809570.105048:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f27dd lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e30 expref: 40 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.105084:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809570.105089:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809570.105128:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2394:x1867312334901504:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 125us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.105135:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2073 00000100:00100000:3.0:1780809570.105145:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:141439:x1867312334901760:12345-192.168.203.33@tcp:35:dd.0 Request processed in 126us (220us total) trans 55834578405 rc 0/0 00000100:00100000:3.0:1780809570.105154:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1688 00000100:00100000:1.0:1780809570.148210:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.148269:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334902016 00000100:00100000:3.0:1780809570.148278:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334902016 00000100:00100000:3.0:1780809570.148326:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1689 00000100:00100000:3.0:1780809570.148337:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:141426:x1867312334902016:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809570.148540:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:141426:x1867312334902016:12345-192.168.203.33@tcp:35:dd.0 Request processed in 203us (334us total) trans 55834578406 rc 0/0 00000100:00100000:3.0:1780809570.148548:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1689 00000100:00100000:2.0F:1780809570.163747:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780809570.163774:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338730880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780809570.163821:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809570.163860:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338730880 00000100:00100000:3.0:1780809570.163868:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338730880 00000100:00100000:3.0:1780809570.163910:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1780809570.163919:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338730880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780809570.163946:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 541655040 pending 15335424 free 3452960768 avail 3450863616 00000100:00100000:3.0:1780809570.163989:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338730880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809570.163997:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1780809570.164022:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338730880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809570.274677:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.274737:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334902272 00000100:00100000:3.0:1780809570.274747:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334902272 00000100:00100000:3.0:1780809570.274799:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7357 00000100:00100000:3.0:1780809570.274809:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:141447:x1867312334902272:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809570.274831:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809570.274848:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f27eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e37 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.274940:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.274954:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.274965:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.274975:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.274991:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.274998:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275124:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2800 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275133:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2800 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275140:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2800 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809570.275150:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809570.275233:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275249:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275256:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275261:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809570.275265:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275273:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275284:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809570.275287:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809570.275292:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275298:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f27f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275311:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275317:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275323:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275329:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809570.275337:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275344:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275352:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:3.0:1780809570.275354:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809570.275357:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275363:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f27f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275395:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f27eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e37 expref: 43 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275410:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2800 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e37 expref: 42 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.275418:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809570.275420:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809570.275422:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809570.275472:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:141447:x1867312334902272:12345-192.168.203.33@tcp:101:dd.0 Request processed in 664us (803us total) trans 55834578407 rc 0/0 00000100:00100000:3.0:1780809570.275479:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7357 00000100:00100000:1.0:1780809570.276750:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.276803:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334902400 00000100:00100000:0.0:1780809570.276809:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334902400 00000100:00100000:0.0:1780809570.276843:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2074 00000100:00100000:0.0:1780809570.276852:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2392:x1867312334902400:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809570.276863:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809570.276877:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2800 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e37 expref: 42 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.276890:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809570.276893:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809570.276920:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2392:x1867312334902400:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.276933:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2074 00000100:00100000:0.0:1780809570.348859:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.348919:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334902528 00000100:00100000:3.0:1780809570.348927:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334902528 00000100:00100000:3.0:1780809570.348969:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7358 00000100:00100000:3.0:1780809570.348976:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:141453:x1867312334902528:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809570.349007:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809570.349023:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f280e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e3e expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349069:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349093:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349101:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349109:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349114:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349120:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349199:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349207:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 42 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349212:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349235:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 42 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.349250:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 42 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.349259:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338731008:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809570.349319:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf5506a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780809570.350201:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338731008:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809570.350216:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809570.350251:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.350290:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334902784 00000100:00100000:3.0:1780809570.350294:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334902784 00000100:00100000:3.0:1780809570.350325:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1690 00000100:00100000:3.0:1780809570.350331:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda786850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:90168:x1867312334902784:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809570.350481:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda786850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:90168:x1867312334902784:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 150us (231us total) trans 55834578408 rc 0/0 00000100:00100000:3.0:1780809570.350486:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1690 00000100:00100000:1.0:1780809570.351155:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.351203:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334902912 00000100:00100000:3.0:1780809570.351208:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334902912 00010000:00010000:3.0:1780809570.351227:0:77613:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 44 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.351254:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 481 00000100:00100000:3.0:1780809570.351261:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2393:x1867312334902912:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780809570.351271:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780809570.351283:0:77613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 44 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.351295:0:77613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 44 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.351311:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2774 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e1b expref: 44 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.351325:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809570.351329:0:77613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.351337:0:77613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.351344:0:77613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.351364:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809570.351391:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.351396:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2393:x1867312334902912:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 134us (241us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809570.351404:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.351409:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 481 00000004:00200000:0.0:1780809570.351434:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809570.351439:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809570.351452:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351463:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351472:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351478:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351522:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351529:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809570.351533:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351541:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351556:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809570.351568:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809570.351572:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351578:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351623:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351630:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351636:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351642:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809570.351645:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351656:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351665:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:0.0:1780809570.351668:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809570.351671:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351676:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f281c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351707:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f280e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 43 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351719:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 42 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.351727:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809570.351729:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809570.351731:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:0.0:1780809570.351760:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:141453:x1867312334902528:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2784us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.351767:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7358 00000100:00100000:1.0:1780809570.353213:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.353258:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334903168 00000100:00100000:3.0:1780809570.353264:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334903168 00000100:00100000:3.0:1780809570.353296:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7359 00000100:00100000:3.0:1780809570.353303:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:141453:x1867312334903168:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809570.353316:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809570.353327:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f282a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e45 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.353401:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.353413:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 43 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.353420:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.353442:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 43 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.353454:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 43 pid: 79214 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.353465:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade5228000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338731136:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809570.353509:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf5506780 going to sleep for 11 seconds 00000100:00100000:3.0:1780809570.354294:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade5228000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338731136:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809570.354309:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809570.354523:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.354558:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334903296 00000100:00100000:0.0:1780809570.354563:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334903296 00010000:00010000:0.0:1780809570.354636:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 44 pid: 79214 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809570.354666:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 482 00000100:00100000:0.0:1780809570.354674:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2394:x1867312334903296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809570.354683:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809570.354689:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 44 pid: 79214 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.354701:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 44 pid: 79214 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.354727:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2823 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e3e expref: 44 pid: 79214 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.354740:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809570.354744:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.354752:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.354758:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.354782:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809570.354803:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.354810:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809570.354814:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2394:x1867312334903296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (289us total) trans 0 rc 0/0 00000004:00200000:3.0:1780809570.354821:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:0.0:1780809570.354825:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 482 00010000:00010000:3.0:1780809570.354912:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f282a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 44 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.354926:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 43 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.354934:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809570.354936:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809570.354939:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030400, rc 0) 00000100:00100000:3.0:1780809570.354970:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:141453:x1867312334903168:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1667us (1758us total) trans 55834578409 rc 0/0 00000100:00100000:3.0:1780809570.354975:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7359 00000100:00100000:1.0:1780809570.493337:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.493398:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334903424 00000100:00100000:0.0:1780809570.493408:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334903424 00000100:00100000:0.0:1780809570.493461:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7360 00000100:00100000:0.0:1780809570.493472:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:141471:x1867312334903424:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809570.493497:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809570.493518:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f283f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e4c expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493576:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493643:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493655:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493668:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493675:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493681:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493771:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493781:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 44 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493789:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493821:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 44 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.493834:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 44 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809570.493859:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd707480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338731264:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809570.493935:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf6a9b600 going to sleep for 11 seconds 00000100:00100000:0.0:1780809570.494702:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd707480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338731264:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809570.494716:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809570.494726:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.494771:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334903680 00000100:00100000:3.0:1780809570.494776:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334903680 00000100:00100000:3.0:1780809570.494813:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1691 00000100:00100000:3.0:1780809570.494823:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:89645:x1867312334903680:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809570.494998:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:89645:x1867312334903680:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 176us (272us total) trans 55834578410 rc 0/0 00000100:00100000:3.0:1780809570.495006:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1691 00000100:00100000:1.0:1780809570.495618:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.495671:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334903808 00000100:00100000:0.0:1780809570.495677:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334903808 00010000:00010000:0.0:1780809570.495696:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 46 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809570.495723:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 483 00000100:00100000:0.0:1780809570.495731:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2391:x1867312334903808:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809570.495741:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809570.495748:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 46 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.495759:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 46 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.495776:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2831 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e45 expref: 46 pid: 80225 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.495788:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809570.495793:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.495807:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.495819:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.495841:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809570.495870:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2391:x1867312334903808:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 140us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.495877:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 483 00010000:00010000:2.0:1780809570.495880:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.495889:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809570.495916:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809570.495921:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809570.495935:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.495945:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.495954:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.495960:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.495967:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.495972:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809570.495976:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.495983:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496004:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809570.496007:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809570.496011:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496018:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496035:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496042:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496047:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496052:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809570.496055:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496061:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496068:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809570.496084:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809570.496088:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496093:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f284d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496129:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f283f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 45 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496143:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 44 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.496149:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809570.496152:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809570.496154:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cea00, rc 0) 00000100:00100000:2.0:1780809570.496185:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:141471:x1867312334903424:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2715us (2857us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809570.496192:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7360 00000100:00100000:1.0:1780809570.498814:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.498863:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334904064 00000100:00100000:3.0:1780809570.498869:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334904064 00000100:00100000:3.0:1780809570.498901:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7361 00000100:00100000:3.0:1780809570.498908:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:141471:x1867312334904064:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809570.498923:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809570.498935:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f285b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e53 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.499000:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.499009:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 45 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.499014:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.499031:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 45 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.499038:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 45 pid: 78216 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.499046:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade5228000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338731392:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809570.499100:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf5506600 going to sleep for 11 seconds 00000100:00100000:3.0:1780809570.499777:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade5228000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338731392:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809570.499792:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809570.499992:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.500040:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334904192 00000100:00100000:3.0:1780809570.500045:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334904192 00010000:00010000:3.0:1780809570.500063:0:77613:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 46 pid: 78216 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.500105:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 484 00000100:00100000:3.0:1780809570.500121:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2392:x1867312334904192:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780809570.500131:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780809570.500138:0:77613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 46 pid: 78216 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.500150:0:77613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 46 pid: 78216 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.500163:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2854 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e4c expref: 46 pid: 78216 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.500179:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809570.500183:0:77613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.500190:0:77613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.500196:0:77613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.500216:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809570.500236:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809570.500245:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809570.500250:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2392:x1867312334904192:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 129us (255us total) trans 0 rc 0/0 00000004:00200000:1.0:1780809570.500260:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:3.0:1780809570.500261:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 484 00010000:00010000:1.0:1780809570.500345:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f285b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 46 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809570.500364:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 45 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809570.500370:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809570.500372:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809570.500373:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:1.0:1780809570.500396:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:141471:x1867312334904064:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1489us (1587us total) trans 55834578411 rc 0/0 00000100:00100000:1.0:1780809570.500404:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7361 00000100:00100000:0.0:1780809570.579846:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809570.579890:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334904448 00000100:00100000:2.0:1780809570.579898:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334904448 00000100:00100000:2.0:1780809570.579944:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7362 00000100:00100000:2.0:1780809570.579956:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:141507:x1867312334904448:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809570.579976:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809570.579991:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e5a expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580045:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580065:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580087:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580103:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580108:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580113:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580225:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2885 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580232:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2885 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580236:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2885 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809570.580243:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809570.580312:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580318:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580322:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580325:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809570.580328:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580341:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580351:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809570.580355:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809570.580359:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580364:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580387:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580395:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580400:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580404:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809570.580405:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580409:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580415:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809570.580416:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809570.580418:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580430:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f287e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580458:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e5a expref: 48 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580467:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2885 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e5a expref: 47 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.580472:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809570.580473:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809570.580475:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809570.580516:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:141507:x1867312334904448:12345-192.168.203.33@tcp:101:dd.0 Request processed in 566us (677us total) trans 55834578412 rc 0/0 00000100:00100000:2.0:1780809570.580520:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7362 00000100:00100000:0.0:1780809570.581636:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809570.581662:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334904576 00000100:00100000:2.0:1780809570.581668:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334904576 00000100:00100000:2.0:1780809570.581710:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2075 00000100:00100000:2.0:1780809570.581720:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2393:x1867312334904576:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809570.581729:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809570.581740:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2885 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e5a expref: 47 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809570.581775:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809570.581779:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809570.581812:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2393:x1867312334904576:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 95us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809570.581826:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2075 00000100:00100000:2.0:1780809570.581987:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.582049:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334904832 00000100:00100000:3.0:1780809570.582055:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334904832 00000100:00100000:3.0:1780809570.582107:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1692 00000100:00100000:3.0:1780809570.582116:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:141507:x1867312334904832:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809570.582239:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:141507:x1867312334904832:12345-192.168.203.33@tcp:35:dd.0 Request processed in 124us (251us total) trans 55834578413 rc 0/0 00000100:00100000:3.0:1780809570.582246:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1692 00000040:00080000:1.0:1780809570.676232:0:78218:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1780809570.730289:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.730339:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334905088 00000100:00100000:0.0:1780809570.730357:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334905088 00000100:00100000:0.0:1780809570.730406:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1693 00000100:00100000:0.0:1780809570.730416:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:141447:x1867312334905088:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809570.730653:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:141447:x1867312334905088:12345-192.168.203.33@tcp:35:dd.0 Request processed in 237us (366us total) trans 55834578414 rc 0/0 00000100:00100000:0.0:1780809570.730662:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1693 00000100:00100000:2.0:1780809570.813798:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.813893:0:77620:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334905216 00000100:00100000:2.0:1780809570.813896:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809570.813922:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809570.813947:0:78806:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334905472 00000100:00100000:2.0:1780809570.813950:0:78806:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334905472 00000100:00100000:0.0:1780809570.813968:0:77620:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334905216 00000100:00100000:0.0:1780809570.814020:0:77620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 379 00000100:00100000:2.0:1780809570.814022:0:78806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 641 00000100:00100000:0.0:1780809570.814033:0:77620:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2394:x1867312334905216:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809570.814037:0:78806:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2394:x1867312334905472:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809570.814115:0:78806:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2394:x1867312334905472:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809570.814122:0:78806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 641 00000100:00100000:0.0:1780809570.814128:0:77620:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2394:x1867312334905216:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 86us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.814137:0:77620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 379 00000100:00100000:2.0:1780809570.814165:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.814202:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334905728 00000100:00100000:0.0:1780809570.814208:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334905728 00000100:00100000:0.0:1780809570.814244:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334905344 00000100:00100000:0.0:1780809570.814247:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334905344 00000100:00100000:2.0:1780809570.814256:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1056 00000100:00100000:2.0:1780809570.814264:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312334905728:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809570.814277:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1057 00000100:00100000:0.0:1780809570.814287:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334905344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809570.814296:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312334905728:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 33us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809570.814301:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1056 00000100:00100000:2.0:1780809570.814325:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.814385:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334905344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.814393:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1057 00000100:00100000:2.0:1780809570.814399:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00080000:2.0:1780809570.814438:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780809570.814442:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780809570.814444:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780809570.814477:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334905856 00000100:00100000:0.0:1780809570.814483:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334905856 00000100:00100000:0.0:1780809570.814516:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1058 00000100:00100000:0.0:1780809570.814523:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312334905856:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:3.0:1780809570.814637:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780809570.814670:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334905600 00000100:00100000:3.0:1780809570.814674:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334905600 00000100:00100000:3.0:1780809570.814715:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 642 00000100:00100000:3.0:1780809570.814725:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334905600:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809570.814781:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334905600:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 58us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809570.814787:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 642 00000100:00100000:0.0:1780809570.814793:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312334905856:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 268us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.814802:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1058 00000100:00080000:3.0:1780809570.814805:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780809570.862787:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809570.862833:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334906112 00000100:00100000:3.0:1780809570.862842:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334906112 00000100:00100000:3.0:1780809570.862895:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7363 00000100:00100000:3.0:1780809570.862906:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:141607:x1867312334906112:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809570.862925:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809570.862941:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e61 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863002:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863013:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863023:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863040:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863045:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863049:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863174:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f28a8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863180:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f28a8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863185:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f28a8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809570.863192:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809570.863257:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863262:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863267:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863270:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809570.863274:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863285:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863294:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809570.863296:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809570.863299:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863302:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f289a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863311:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863315:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863318:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863321:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809570.863322:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863325:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863329:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:3.0:1780809570.863330:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809570.863332:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863341:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f28a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863365:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e61 expref: 51 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863373:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f28a8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e61 expref: 50 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809570.863378:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809570.863380:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809570.863381:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809570.863427:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:141607:x1867312334906112:12345-192.168.203.33@tcp:101:dd.0 Request processed in 523us (647us total) trans 55834578415 rc 0/0 00000100:00100000:3.0:1780809570.863434:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7363 00000100:00100000:2.0:1780809570.864577:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809570.864639:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334906240 00000100:00100000:0.0:1780809570.864645:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334906240 00000100:00100000:0.0:1780809570.864687:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2076 00000100:00100000:0.0:1780809570.864697:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4996d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2391:x1867312334906240:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809570.864707:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809570.864720:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f28a8 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e61 expref: 50 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809570.864734:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809570.864738:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809570.864774:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4996d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2391:x1867312334906240:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809570.864782:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2076 00010000:00010000:0.0:1780809570.867695:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809571.042189:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.042237:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334906496 00000100:00100000:1.0:1780809571.042251:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334906496 00000100:00100000:1.0:1780809571.042292:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7364 00000100:00100000:1.0:1780809571.042300:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:141626:x1867312334906496:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809571.042319:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809571.042334:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f28b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e68 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042387:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042397:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042404:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042411:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042416:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042420:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042511:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f28cb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042517:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f28cb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042521:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f28cb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809571.042533:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809571.042652:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042658:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042662:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042666:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809571.042669:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042675:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042683:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809571.042685:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809571.042688:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042691:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f28bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042698:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042701:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042712:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042716:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809571.042717:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042721:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042725:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:1.0:1780809571.042726:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809571.042728:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042731:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f28c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042754:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f28b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e68 expref: 52 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042762:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f28cb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e68 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.042767:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809571.042768:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809571.042770:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64c00, rc 0) 00000100:00100000:1.0:1780809571.042812:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:141626:x1867312334906496:12345-192.168.203.33@tcp:101:dd.0 Request processed in 514us (631us total) trans 55834578416 rc 0/0 00000100:00100000:1.0:1780809571.042825:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7364 00000100:00100000:3.0:1780809571.043762:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.043802:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334906624 00000100:00100000:1.0:1780809571.043807:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334906624 00000100:00100000:1.0:1780809571.043837:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2077 00000100:00100000:1.0:1780809571.043843:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2392:x1867312334906624:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809571.043850:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809571.043860:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f28cb lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e68 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.043868:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809571.043871:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809571.043893:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2392:x1867312334906624:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809571.043898:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2077 00000100:00100000:3.0:1780809571.043999:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.044032:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334906880 00000100:00100000:1.0:1780809571.044037:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334906880 00000100:00100000:1.0:1780809571.044076:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1694 00000100:00100000:1.0:1780809571.044083:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:141626:x1867312334906880:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809571.044184:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:141626:x1867312334906880:12345-192.168.203.33@tcp:35:dd.0 Request processed in 97us (181us total) trans 55834578417 rc 0/0 00000100:00100000:1.0:1780809571.044192:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1694 00000001:00080000:1.0:1780809571.195682:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578414 is committed 00010000:00010000:3.0:1780809571.195697:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f25f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780809571.195702:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578417 is committed 00010000:00010000:3.0:1780809571.195709:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f25f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.195716:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f25f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.195720:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809571.195729:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f25f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.195735:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f25f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.195748:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:3.0:1780809571.195750:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809571.195755:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f25f3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.195761:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f25f3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809571.235687:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.235729:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334907008 00000100:00100000:0.0:1780809571.235736:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334907008 00000100:00100000:0.0:1780809571.235786:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7365 00000100:00100000:0.0:1780809571.235793:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+17:141662:x1867312334907008:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809571.235811:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809571.235826:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f28d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e6f expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.235878:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.235888:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.235896:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.235906:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.235912:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.235918:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.236265:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.236282:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 18 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.236290:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.236317:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 18 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.236330:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 18 pid: 77627 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809571.236340:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338731520:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809571.236401:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded373f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780809571.237243:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338731520:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809571.237261:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809571.237428:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.237502:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334907264 00000100:00100000:0.0:1780809571.237507:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334907264 00000100:00100000:0.0:1780809571.237538:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1695 00000100:00100000:0.0:1780809571.237545:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:89645:x1867312334907264:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809571.237760:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:89645:x1867312334907264:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 208us (324us total) trans 55834578418 rc 0/0 00000100:00100000:0.0:1780809571.237768:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1695 00000100:00100000:3.0:1780809571.238816:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809571.238871:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334907392 00000100:00100000:2.0:1780809571.238876:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334907392 00010000:00010000:2.0:1780809571.238900:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 20 pid: 77627 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809571.238931:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 485 00000100:00100000:2.0:1780809571.238941:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2391:x1867312334907392:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809571.238951:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809571.238958:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 20 pid: 77627 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.238972:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 20 pid: 77627 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.238989:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2862 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e53 expref: 20 pid: 77627 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.239001:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809571.239006:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.239014:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.239021:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.239057:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809571.239089:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809571.239100:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2391:x1867312334907392:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 160us (283us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809571.239116:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809571.239123:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 485 00000004:00200000:0.0:1780809571.239141:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809571.239146:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809571.239156:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239164:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239171:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239176:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239181:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239184:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809571.239187:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239192:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239198:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809571.239200:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809571.239204:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239260:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f28e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239274:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239278:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239282:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239284:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809571.239286:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239290:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239294:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83000) 00010000:00010000:0.0:1780809571.239296:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809571.239298:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239301:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f28e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239323:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f28d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 19 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239341:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 18 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.239346:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809571.239347:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809571.239349:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cec00, rc 0) 00000100:00100000:0.0:1780809571.239377:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:141662:x1867312334907008:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3583us (3699us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809571.239383:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7365 00000100:00100000:3.0:1780809571.245928:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809571.245978:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334907648 00000100:00100000:2.0:1780809571.245988:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334907648 00000100:00100000:2.0:1780809571.246037:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7366 00000100:00100000:2.0:1780809571.246048:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:141662:x1867312334907648:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809571.246088:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809571.246112:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f28f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e76 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.246200:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.246215:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 19 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.246224:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.246256:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 19 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.246269:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 19 pid: 77629 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809571.246282:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc4995500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338731648:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809571.246351:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd9d05b40 going to sleep for 11 seconds 00000100:00100000:2.0:1780809571.249882:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc4995500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338731648:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809571.249912:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809571.250085:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.250166:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334907776 00000100:00100000:0.0:1780809571.250172:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334907776 00010000:00010000:0.0:1780809571.250197:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 20 pid: 77629 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809571.250229:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 486 00000100:00100000:0.0:1780809571.250239:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2392:x1867312334907776:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809571.250253:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809571.250258:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 20 pid: 77629 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.250268:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 20 pid: 77629 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.250285:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f28ee lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e6f expref: 20 pid: 77629 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.250311:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809571.250315:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.250321:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.250326:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.250345:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809571.250383:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809571.250390:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2392:x1867312334907776:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 152us (306us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809571.250396:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809571.250400:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 486 00000004:00200000:2.0:1780809571.250417:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809571.250547:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f28f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 20 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.250575:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 19 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.250581:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809571.250583:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809571.250585:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809571.250644:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:141662:x1867312334907648:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 4599us (4723us total) trans 55834578419 rc 0/0 00000100:00100000:2.0:1780809571.250649:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7366 00000100:00100000:3.0:1780809571.260578:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.260631:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334908032 00000100:00100000:1.0:1780809571.260641:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334908032 00000100:00100000:1.0:1780809571.260686:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1696 00000100:00100000:1.0:1780809571.260696:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda786c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:141607:x1867312334908032:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809571.260905:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda786c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:141607:x1867312334908032:12345-192.168.203.33@tcp:35:dd.0 Request processed in 211us (333us total) trans 55834578420 rc 0/0 00000100:00100000:1.0:1780809571.260912:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1696 00000100:00100000:3.0:1780809571.392192:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.392236:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334908288 00000100:00100000:0.0:1780809571.392245:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334908288 00000100:00100000:0.0:1780809571.392290:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7367 00000100:00100000:0.0:1780809571.392296:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:141670:x1867312334908288:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809571.392315:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809571.392332:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f290a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e7d expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392402:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392416:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392442:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392455:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392462:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392468:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392776:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f291f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392783:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f291f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392787:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f291f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809571.392795:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809571.392856:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392861:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392865:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392868:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809571.392876:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392881:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392889:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809571.392891:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809571.392895:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392899:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392913:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392919:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392924:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392929:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809571.392932:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392938:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392945:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:0.0:1780809571.392948:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809571.392957:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392962:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2918 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.392994:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f290a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e7d expref: 23 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.393002:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f291f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e7d expref: 22 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.393007:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809571.393009:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809571.393010:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf400, rc 0) 00000100:00100000:0.0:1780809571.393058:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:141670:x1867312334908288:12345-192.168.203.33@tcp:101:dd.0 Request processed in 762us (874us total) trans 55834578421 rc 0/0 00000100:00100000:0.0:1780809571.393063:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7367 00000100:00100000:3.0:1780809571.394073:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.394118:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334908416 00000100:00100000:1.0:1780809571.394124:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334908416 00000100:00100000:1.0:1780809571.394166:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2078 00000100:00100000:1.0:1780809571.394175:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:2394:x1867312334908416:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809571.394183:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809571.394194:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f291f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e7d expref: 22 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.394207:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809571.394210:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809571.394242:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:2394:x1867312334908416:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809571.394249:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2078 00000100:00100000:3.0:1780809571.590311:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809571.590374:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334908672 00000100:00100000:2.0:1780809571.590382:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334908672 00000100:00100000:2.0:1780809571.590425:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7368 00000100:00100000:2.0:1780809571.590432:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:141683:x1867312334908672:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809571.590450:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809571.590466:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f292d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e84 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590527:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590537:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590544:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590553:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590557:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590561:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590826:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2942 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590833:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2942 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590837:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2942 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809571.590844:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809571.590906:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590917:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590922:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590925:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809571.590928:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590934:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590942:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809571.590944:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809571.590946:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590950:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590969:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590973:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590977:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590979:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809571.590984:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590988:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590992:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54c00) 00010000:00010000:2.0:1780809571.590993:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809571.590995:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.590998:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f293b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.591040:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f292d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e84 expref: 24 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.591050:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2942 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e84 expref: 23 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.591054:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809571.591055:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809571.591057:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:2.0:1780809571.591110:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:141683:x1867312334908672:12345-192.168.203.33@tcp:101:dd.0 Request processed in 678us (810us total) trans 55834578422 rc 0/0 00000100:00100000:2.0:1780809571.591117:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7368 00000100:00100000:3.0:1780809571.592262:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809571.592286:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.592294:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334909056 00000100:00100000:0.0:1780809571.592299:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334909056 00000100:00100000:2.0:1780809571.592324:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334908800 00000100:00100000:2.0:1780809571.592330:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334908800 00000100:00100000:0.0:1780809571.592332:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1697 00000100:00100000:0.0:1780809571.592341:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141683:x1867312334909056:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809571.592364:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2079 00000100:00100000:2.0:1780809571.592375:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2391:x1867312334908800:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809571.592393:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809571.592408:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2942 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e84 expref: 25 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.592428:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809571.592433:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809571.592439:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141683:x1867312334909056:12345-192.168.203.33@tcp:35:dd.0 Request processed in 100us (178us total) trans 55834578423 rc 0/0 00000100:00100000:0.0:1780809571.592445:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1697 00000100:00100000:2.0:1780809571.592461:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2391:x1867312334908800:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809571.592468:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2079 00000100:00100000:3.0:1780809571.716292:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.716336:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334909312 00000100:00100000:1.0:1780809571.716346:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334909312 00000100:00100000:1.0:1780809571.716396:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1698 00000100:00100000:1.0:1780809571.716407:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:141670:x1867312334909312:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809571.716577:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141670:x1867312334909312:12345-192.168.203.33@tcp:35:dd.0 Request processed in 174us (292us total) trans 55834578424 rc 0/0 00000100:00100000:1.0:1780809571.716626:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1698 00000100:00100000:3.0:1780809571.739457:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809571.739511:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334909568 00000100:00100000:2.0:1780809571.739519:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334909568 00000100:00100000:2.0:1780809571.739560:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7369 00000100:00100000:2.0:1780809571.739568:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141691:x1867312334909568:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809571.739585:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809571.739624:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e8b expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739677:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739688:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739695:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739703:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739718:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739723:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739966:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2965 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739972:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2965 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.739976:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2965 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809571.739983:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809571.740049:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740054:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740059:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740075:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809571.740077:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740082:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740098:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809571.740100:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809571.740104:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740107:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740131:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740135:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740138:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740141:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809571.740143:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740146:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740150:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54c00) 00010000:00010000:2.0:1780809571.740151:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809571.740153:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740156:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f295e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740198:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e8b expref: 27 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740208:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2965 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e8b expref: 26 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.740213:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809571.740215:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809571.740218:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ec00, rc 0) 00000100:00100000:2.0:1780809571.740268:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:141691:x1867312334909568:12345-192.168.203.33@tcp:101:dd.0 Request processed in 701us (817us total) trans 55834578425 rc 0/0 00000100:00100000:2.0:1780809571.740273:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7369 00000100:00100000:3.0:1780809571.741223:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.741270:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334909696 00000100:00100000:0.0:1780809571.741275:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334909696 00000100:00100000:0.0:1780809571.741311:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2080 00000100:00100000:0.0:1780809571.741320:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2392:x1867312334909696:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809571.741337:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809571.741349:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2965 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e8b expref: 26 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.741364:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809571.741367:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809571.741392:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:2392:x1867312334909696:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 75us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809571.741396:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2080 00010000:00010000:1.0:1780809571.891745:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809571.980961:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.981016:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334909824 00000100:00100000:1.0:1780809571.981024:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334909824 00000100:00100000:1.0:1780809571.981078:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7370 00000100:00100000:1.0:1780809571.981088:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:141697:x1867312334909824:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809571.981108:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809571.981127:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f2973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e92 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981183:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981194:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981201:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981210:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981214:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981218:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981438:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981450:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 26 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981455:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981478:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 26 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.981487:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 26 pid: 80225 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809571.981497:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338731776:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809571.981550:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded298240 going to sleep for 11 seconds 00000100:00100000:1.0:1780809571.982371:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338731776:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809571.982384:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809571.982614:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.982657:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334910080 00000100:00100000:0.0:1780809571.982662:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334910080 00000100:00100000:0.0:1780809571.982736:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1699 00000100:00100000:0.0:1780809571.982746:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:89646:x1867312334910080:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809571.982910:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:89646:x1867312334910080:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 165us (293us total) trans 55834578426 rc 0/0 00000100:00100000:0.0:1780809571.982919:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1699 00000100:00100000:3.0:1780809571.983616:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809571.983658:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334910208 00000100:00100000:1.0:1780809571.983662:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334910208 00010000:00010000:1.0:1780809571.983678:0:77613:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 28 pid: 80225 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809571.983697:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 487 00000100:00100000:1.0:1780809571.983701:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2393:x1867312334910208:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809571.983709:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809571.983719:0:77613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 28 pid: 80225 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.983727:0:77613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 28 pid: 80225 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.983740:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f28fc lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e76 expref: 28 pid: 80225 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.983759:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809571.983762:0:77613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.983768:0:77613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.983772:0:77613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809571.983788:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809571.983810:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809571.983825:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2393:x1867312334910208:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 120us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809571.983828:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809571.983839:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 487 00000004:00200000:3.0:1780809571.983860:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809571.983866:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809571.983880:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983891:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983901:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983908:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983916:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983921:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809571.983924:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983931:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983938:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809571.983940:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809571.983943:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983954:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f297a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983962:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983965:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983969:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983972:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809571.983973:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983977:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983982:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f900) 00010000:00010000:3.0:1780809571.983983:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809571.983985:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.983988:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f2981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.984012:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f2973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 27 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.984046:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 26 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809571.984054:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809571.984057:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809571.984070:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64000, rc 0) 00000100:00100000:3.0:1780809571.984104:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:141697:x1867312334909824:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3017us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809571.984110:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7370 00000100:00100000:3.0:1780809571.985650:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809571.985689:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334910464 00000100:00100000:0.0:1780809571.985693:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334910464 00000100:00100000:0.0:1780809571.985717:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7371 00000100:00100000:0.0:1780809571.985722:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:141697:x1867312334910464:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809571.985732:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809571.985743:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f298f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871e99 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.985787:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.985803:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 27 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.985808:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.985825:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 27 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.985833:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 27 pid: 77627 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809571.985841:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338731904:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809571.985882:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded373f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780809571.986573:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338731904:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809571.986611:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809571.986778:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809571.986822:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334910592 00000100:00100000:2.0:1780809571.986827:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334910592 00010000:00010000:2.0:1780809571.986847:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 28 pid: 77627 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809571.986876:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 488 00000100:00100000:2.0:1780809571.986884:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2391:x1867312334910592:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809571.986893:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809571.986898:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 28 pid: 77627 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.986909:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 28 pid: 77627 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.986933:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f2988 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e92 expref: 28 pid: 77627 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.986944:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809571.986948:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.986954:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.986959:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809571.986977:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809571.986999:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.987005:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809571.987011:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2391:x1867312334910592:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 126us (230us total) trans 0 rc 0/0 00000004:00200000:0.0:1780809571.987018:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809571.987019:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 488 00010000:00010000:0.0:1780809571.987175:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f298f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 28 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.987198:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 27 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809571.987203:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809571.987205:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809571.987207:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf000, rc 0) 00000100:00100000:0.0:1780809571.987228:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:141697:x1867312334910464:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1506us (1581us total) trans 55834578427 rc 0/0 00000100:00100000:0.0:1780809571.987232:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7371 00000100:00100000:3.0:1780809572.040235:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809572.040274:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809572.040284:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334910848 00000100:00100000:2.0:1780809572.040293:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334910848 00000100:00100000:1.0:1780809572.040317:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334911104 00000100:00100000:1.0:1780809572.040327:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334911104 00000100:00080000:3.0:1780809572.040330:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780809572.040348:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7372 00000100:00100000:1.0:1780809572.040357:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1700 00000100:00100000:2.0:1780809572.040361:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:141704:x1867312334910848:12345-192.168.203.33@tcp:101:dd.0 00000100:00100000:1.0:1780809572.040370:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:141691:x1867312334911104:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809572.040379:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809572.040395:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f29a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ea0 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040442:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040463:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040472:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040483:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040488:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040493:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809572.040532:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:141691:x1867312334911104:12345-192.168.203.33@tcp:35:dd.0 Request processed in 166us (258us total) trans 55834578428 rc 0/0 00000100:00100000:1.0:1780809572.040551:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1700 00010000:00010000:2.0:1780809572.040774:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f29b9 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040780:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f29b9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040785:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f29b9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809572.040791:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809572.040830:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040835:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040839:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040847:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809572.040850:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040855:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040863:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809572.040865:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809572.040867:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040871:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f29ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040887:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040891:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040894:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040897:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809572.040898:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040902:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040911:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54c00) 00010000:00010000:2.0:1780809572.040913:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809572.040914:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040917:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f29b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040949:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f29a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ea0 expref: 31 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040957:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f29b9 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ea0 expref: 30 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.040962:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809572.040963:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809572.040965:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:2.0:1780809572.040989:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:141704:x1867312334910848:12345-192.168.203.33@tcp:101:dd.0 Request processed in 634us (763us total) trans 55834578429 rc 0/0 00000100:00100000:2.0:1780809572.040993:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7372 00000100:00100000:3.0:1780809572.042048:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.042098:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334911232 00000100:00100000:0.0:1780809572.042103:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334911232 00000100:00100000:0.0:1780809572.042148:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2081 00000100:00100000:0.0:1780809572.042158:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2392:x1867312334911232:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809572.042167:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809572.042180:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f29b9 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ea0 expref: 30 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.042193:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.042196:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809572.042219:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2392:x1867312334911232:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809572.042224:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2081 00000100:00100000:2.0:1780809572.335991:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.336037:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334911488 00000100:00100000:0.0:1780809572.336046:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334911488 00000100:00100000:0.0:1780809572.336096:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1701 00000100:00100000:0.0:1780809572.336115:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:141704:x1867312334911488:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809572.336285:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:141704:x1867312334911488:12345-192.168.203.33@tcp:35:dd.0 Request processed in 172us (303us total) trans 55834578430 rc 0/0 00000100:00100000:0.0:1780809572.336291:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1701 00000100:00100000:3.0:1780809572.463890:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.463942:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334911744 00000100:00100000:0.0:1780809572.463952:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334911744 00000100:00100000:0.0:1780809572.464001:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7373 00000100:00100000:0.0:1780809572.464011:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:141712:x1867312334911744:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809572.464033:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809572.464052:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f29c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ea7 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464152:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464167:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464178:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464191:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464199:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464206:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464561:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f29dc lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464572:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f29dc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464580:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f29dc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809572.464628:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809572.464708:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464717:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464724:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464730:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.464734:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464742:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464753:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809572.464757:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.464761:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464777:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464795:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464802:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464809:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464815:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfc00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.464819:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464826:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464835:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:0.0:1780809572.464839:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.464842:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464849:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464888:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f29c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ea7 expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464913:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f29dc lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ea7 expref: 32 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.464921:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.464924:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809572.464926:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfe00, rc 0) 00000100:00100000:0.0:1780809572.464976:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:141712:x1867312334911744:12345-192.168.203.33@tcp:101:dd.0 Request processed in 966us (1094us total) trans 55834578431 rc 0/0 00000100:00100000:0.0:1780809572.464985:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7373 00000100:00100000:3.0:1780809572.466031:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809572.466082:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334911872 00000100:00100000:1.0:1780809572.466087:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334911872 00000100:00100000:1.0:1780809572.466124:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2082 00000100:00100000:1.0:1780809572.466130:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:2391:x1867312334911872:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809572.466138:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809572.466148:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f29dc lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ea7 expref: 32 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.466160:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809572.466163:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809572.466186:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2391:x1867312334911872:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809572.466190:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2082 00000100:00100000:2.0:1780809572.617444:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.617487:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334912000 00000100:00100000:0.0:1780809572.617495:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334912000 00000100:00100000:0.0:1780809572.617536:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7374 00000100:00100000:0.0:1780809572.617542:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:141725:x1867312334912000:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809572.617561:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809572.617576:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f29ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871eae expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617645:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617656:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617663:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617672:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617686:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617690:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617952:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617960:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 32 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617966:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617987:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 32 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.617996:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 32 pid: 77629 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.618005:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338732032:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809572.618080:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded373f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780809572.618737:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338732032:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809572.618751:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.618896:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809572.618943:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334912256 00000100:00100000:1.0:1780809572.618948:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334912256 00000100:00100000:1.0:1780809572.618979:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1702 00000100:00100000:1.0:1780809572.618987:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda785050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:90168:x1867312334912256:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809572.619137:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda785050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:90168:x1867312334912256:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 152us (241us total) trans 55834578432 rc 0/0 00000100:00100000:1.0:1780809572.619143:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1702 00000100:00100000:3.0:1780809572.619743:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809572.619791:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334912384 00000100:00100000:2.0:1780809572.619796:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334912384 00010000:00010000:2.0:1780809572.619824:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 34 pid: 77629 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.619863:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 489 00000100:00100000:2.0:1780809572.619871:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01281c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2394:x1867312334912384:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809572.619881:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809572.619887:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 34 pid: 77629 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.619908:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 34 pid: 77629 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.619923:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2996 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871e99 expref: 34 pid: 77629 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.619941:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809572.619945:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.619951:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.619957:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.619977:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809572.620004:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01281c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2394:x1867312334912384:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 134us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809572.620010:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.620011:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 489 00010000:00010000:0.0:1780809572.620025:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809572.620051:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809572.620066:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809572.620081:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620091:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620100:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620146:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620153:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620158:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfc00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.620162:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620169:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620177:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809572.620180:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.620183:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620198:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f29f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620209:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620216:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620222:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620227:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.620230:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620236:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620244:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:0.0:1780809572.620247:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.620250:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620256:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f29f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620282:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f29ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 33 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620306:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 32 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.620313:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.620316:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809572.620318:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf800, rc 0) 00000100:00100000:0.0:1780809572.620348:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:141725:x1867312334912000:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2805us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809572.620356:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7374 00000100:00100000:3.0:1780809572.621609:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.621633:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334912640 00000100:00100000:0.0:1780809572.621637:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334912640 00000100:00100000:0.0:1780809572.621658:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7375 00000100:00100000:0.0:1780809572.621663:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:141725:x1867312334912640:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809572.621672:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809572.621679:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2a06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871eb5 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.621718:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.621725:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 33 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.621730:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.621742:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 33 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.621755:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 33 pid: 77628 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.621762:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338732160:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809572.621792:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded3733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809572.622409:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338732160:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809572.622418:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809572.622618:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.622640:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334912768 00000100:00100000:0.0:1780809572.622645:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334912768 00010000:00010000:0.0:1780809572.622694:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 34 pid: 77628 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.622715:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 490 00000100:00100000:0.0:1780809572.622721:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2393:x1867312334912768:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809572.622727:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809572.622734:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 34 pid: 77628 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.622742:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 34 pid: 77628 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.622750:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f29ff lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eae expref: 34 pid: 77628 timeout: 1934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.622767:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.622769:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.622774:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.622778:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.622790:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809572.622808:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.622821:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2393:x1867312334912768:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 98us (201us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809572.622828:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.622834:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 490 00000004:00200000:2.0:1780809572.622844:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809572.622919:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2a06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 34 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.622933:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 33 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.622940:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809572.622943:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809572.622946:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce600, rc 0) 00000100:00100000:2.0:1780809572.622975:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:141725:x1867312334912640:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1310us (1366us total) trans 55834578433 rc 0/0 00000100:00100000:2.0:1780809572.622981:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7375 00000100:00100000:3.0:1780809572.759928:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809572.759991:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334913024 00000100:00100000:1.0:1780809572.760000:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334913024 00000100:00100000:1.0:1780809572.760069:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7376 00000100:00100000:1.0:1780809572.760079:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:141732:x1867312334913024:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809572.760115:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809572.760134:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ebc expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760201:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760215:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760227:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760240:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760246:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760252:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760630:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2a30 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760640:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2a30 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760647:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2a30 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809572.760657:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809572.760756:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760764:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760771:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760776:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809572.760780:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760787:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760798:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809572.760800:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809572.760805:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760810:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760820:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760825:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760831:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760845:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809572.760847:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760853:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760861:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f000) 00010000:00010000:1.0:1780809572.760863:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809572.760865:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760871:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2a29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760907:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ebc expref: 36 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760920:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2a30 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ebc expref: 35 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.760927:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809572.760929:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809572.760932:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:1.0:1780809572.760987:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:141732:x1867312334913024:12345-192.168.203.33@tcp:101:dd.0 Request processed in 910us (1067us total) trans 55834578434 rc 0/0 00000100:00100000:1.0:1780809572.760994:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7376 00000100:00100000:3.0:1780809572.762072:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809572.762108:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809572.762111:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334913152 00000100:00100000:1.0:1780809572.762124:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334913152 00000100:00100000:0.0:1780809572.762145:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334913408 00000100:00100000:0.0:1780809572.762150:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334913408 00000100:00100000:1.0:1780809572.762166:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2083 00000100:00100000:1.0:1780809572.762176:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2392:x1867312334913152:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809572.762188:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1780809572.762189:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1703 00000100:00100000:0.0:1780809572.762201:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:141732:x1867312334913408:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809572.762207:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2a30 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ebc expref: 36 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.762220:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809572.762224:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809572.762258:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2392:x1867312334913152:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809572.762265:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2083 00000100:00100000:0.0:1780809572.762314:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:141732:x1867312334913408:12345-192.168.203.33@tcp:35:dd.0 Request processed in 116us (205us total) trans 55834578435 rc 0/0 00000100:00100000:0.0:1780809572.762322:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1703 00000100:00100000:3.0:1780809572.853446:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.853509:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334913536 00000100:00100000:0.0:1780809572.853519:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334913536 00000100:00100000:0.0:1780809572.853579:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7377 00000100:00100000:0.0:1780809572.853614:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:141739:x1867312334913536:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809572.853637:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809572.853666:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ec3 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.853736:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.853750:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.853760:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.853775:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.853783:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.853789:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.854140:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.854153:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 36 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.854162:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.854193:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 36 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.854218:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 36 pid: 78216 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.854232:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338732288:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809572.854306:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded3733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809572.855143:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338732288:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809572.855162:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809572.855191:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809572.855237:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334913792 00000100:00100000:1.0:1780809572.855243:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334913792 00000100:00100000:1.0:1780809572.855278:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1704 00000100:00100000:1.0:1780809572.855287:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:90168:x1867312334913792:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809572.855440:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:90168:x1867312334913792:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 154us (250us total) trans 55834578436 rc 0/0 00000100:00100000:1.0:1780809572.855448:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1704 00000100:00100000:3.0:1780809572.856124:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809572.856178:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334913920 00000100:00100000:2.0:1780809572.856183:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334913920 00010000:00010000:2.0:1780809572.856203:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 38 pid: 78216 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.856229:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 491 00000100:00100000:2.0:1780809572.856234:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2394:x1867312334913920:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809572.856242:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809572.856246:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 38 pid: 78216 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.856264:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 38 pid: 78216 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.856277:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2a0d lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eb5 expref: 38 pid: 78216 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.856291:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809572.856294:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.856298:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.856302:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.856318:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809572.856338:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2394:x1867312334913920:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 104us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809572.856343:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 491 00010000:00010000:0.0:1780809572.856360:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856370:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809572.856396:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809572.856402:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809572.856415:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856425:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856477:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856484:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856501:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856507:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.856511:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856518:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856528:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809572.856531:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.856535:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856540:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856552:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856558:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856564:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856568:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.856571:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856585:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856620:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:0.0:1780809572.856623:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.856627:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856633:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856668:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 37 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856682:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 36 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.856689:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.856692:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809572.856694:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfc00, rc 0) 00000100:00100000:0.0:1780809572.856728:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:141739:x1867312334913536:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3140us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809572.856734:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7377 00000100:00100000:3.0:1780809572.858085:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809572.858117:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334914176 00000100:00100000:2.0:1780809572.858123:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334914176 00000100:00100000:2.0:1780809572.858155:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7378 00000100:00100000:2.0:1780809572.858163:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:141739:x1867312334914176:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809572.858176:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809572.858187:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871eca expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.858258:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.858269:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 37 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.858278:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.858302:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 37 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.858314:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 37 pid: 77629 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.858325:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc4997800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338732416:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809572.858374:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc4dd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1780809572.859003:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc4997800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338732416:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809572.859018:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809572.859230:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.859264:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334914304 00000100:00100000:0.0:1780809572.859269:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334914304 00010000:00010000:0.0:1780809572.859331:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 38 pid: 77629 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.859364:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 492 00000100:00100000:0.0:1780809572.859372:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2393:x1867312334914304:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809572.859382:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809572.859389:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 38 pid: 77629 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.859400:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 38 pid: 77629 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.859411:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a53 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ec3 expref: 38 pid: 77629 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.859422:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.859425:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.859430:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.859434:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.859448:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809572.859470:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2393:x1867312334914304:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809572.859475:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 492 00010000:00010000:2.0:1780809572.859477:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.859486:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809572.859497:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809572.859623:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 38 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.859653:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 37 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.859661:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809572.859664:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809572.859666:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:2.0:1780809572.859697:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:141739:x1867312334914176:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1535us (1612us total) trans 55834578437 rc 0/0 00000100:00100000:2.0:1780809572.859704:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7378 00010000:00010000:0.0:1780809572.915709:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809572.991501:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.991550:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334914432 00000100:00100000:0.0:1780809572.991561:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334914432 00000100:00100000:0.0:1780809572.991646:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7379 00000100:00100000:0.0:1780809572.991658:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:141746:x1867312334914432:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809572.991681:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809572.991701:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ed1 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.991760:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.991775:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.991786:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.991800:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.991808:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.991815:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.992159:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.992170:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 38 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.992187:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.992215:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 38 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.992229:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 38 pid: 80225 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.992242:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338732544:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809572.992312:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded3733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809572.993017:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338732544:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809572.993030:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809572.993142:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809572.993189:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334914688 00000100:00100000:0.0:1780809572.993231:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334914688 00000100:00100000:0.0:1780809572.993263:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1705 00000100:00100000:0.0:1780809572.993270:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:89645:x1867312334914688:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809572.993415:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:89645:x1867312334914688:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 145us (272us total) trans 55834578438 rc 0/0 00000100:00100000:0.0:1780809572.993423:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1705 00000100:00100000:3.0:1780809572.994077:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809572.994121:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334914816 00000100:00100000:1.0:1780809572.994125:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334914816 00010000:00010000:1.0:1780809572.994141:0:77613:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 40 pid: 80225 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809572.994162:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 493 00000100:00100000:1.0:1780809572.994167:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2394:x1867312334914816:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809572.994181:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809572.994185:0:77613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 40 pid: 80225 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.994195:0:77613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 40 pid: 80225 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.994207:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2a61 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eca expref: 40 pid: 80225 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.994228:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809572.994231:0:77613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.994236:0:77613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.994240:0:77613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809572.994253:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809572.994274:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2394:x1867312334914816:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809572.994281:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 493 00010000:00010000:0.0:1780809572.994293:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994300:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809572.994327:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809572.994330:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809572.994341:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994349:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994355:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994359:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994364:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994367:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.994369:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994373:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994380:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809572.994382:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.994386:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994391:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2a76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994456:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994463:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994469:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994475:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809572.994478:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994484:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994492:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:0.0:1780809572.994494:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809572.994497:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994502:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2a7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994528:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 39 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994540:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 38 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.994557:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.994559:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809572.994562:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cec00, rc 0) 00000100:00100000:0.0:1780809572.994633:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:141746:x1867312334914432:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2978us (3144us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809572.994641:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7379 00000100:00100000:3.0:1780809572.995930:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809572.995976:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334915072 00000100:00100000:2.0:1780809572.995982:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334915072 00000100:00100000:2.0:1780809572.996017:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7380 00000100:00100000:2.0:1780809572.996028:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:141746:x1867312334915072:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809572.996040:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809572.996050:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ed8 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.996119:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.996131:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 39 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.996140:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.996173:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 39 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.996186:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 39 pid: 79214 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.996197:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc4997800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338732672:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809572.996245:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc4dd2180 going to sleep for 11 seconds 00000100:00100000:2.0:1780809572.996850:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc4997800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338732672:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809572.996863:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809572.997045:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809572.997098:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334915200 00000100:00100000:2.0:1780809572.997102:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334915200 00010000:00010000:2.0:1780809572.997120:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 40 pid: 79214 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.997145:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 494 00000100:00100000:2.0:1780809572.997153:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2393:x1867312334915200:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809572.997160:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809572.997165:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 40 pid: 79214 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.997174:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 40 pid: 79214 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.997200:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2a84 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed1 expref: 40 pid: 79214 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.997214:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809572.997219:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.997226:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.997232:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809572.997251:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809572.997265:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.997272:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809572.997279:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2393:x1867312334915200:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 126us (233us total) trans 0 rc 0/0 00000004:00200000:0.0:1780809572.997280:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809572.997291:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 494 00010000:00010000:0.0:1780809572.997355:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 40 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.997428:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 39 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809572.997434:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809572.997436:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809572.997437:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f200, rc 0) 00000100:00100000:0.0:1780809572.997460:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:141746:x1867312334915072:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1436us (1531us total) trans 55834578439 rc 0/0 00000100:00100000:0.0:1780809572.997464:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7380 00000100:00100000:0.0:1780809573.059535:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.059604:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334915456 00000100:00100000:1.0:1780809573.059614:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334915456 00000100:00100000:1.0:1780809573.059664:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1706 00000100:00100000:1.0:1780809573.059674:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:141732:x1867312334915456:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809573.059856:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:141732:x1867312334915456:12345-192.168.203.33@tcp:35:dd.0 Request processed in 184us (326us total) trans 55834578440 rc 0/0 00000100:00100000:1.0:1780809573.059861:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1706 00000100:00100000:3.0:1780809573.090634:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.090678:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334915712 00000100:00100000:0.0:1780809573.090688:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334915712 00000100:00100000:0.0:1780809573.090731:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7381 00000100:00100000:0.0:1780809573.090738:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:141754:x1867312334915712:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809573.090756:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809573.090772:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871edf expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.090824:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.090834:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.090842:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.090850:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.090854:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.090858:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091130:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2ab5 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091136:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2ab5 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091146:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2ab5 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809573.091154:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809573.091229:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091237:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091244:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091250:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809573.091254:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091261:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091271:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809573.091274:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809573.091277:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091281:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091294:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091305:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091309:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091318:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809573.091320:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091324:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091328:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:0.0:1780809573.091330:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809573.091332:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091336:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091364:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871edf expref: 43 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091373:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2ab5 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871edf expref: 42 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.091377:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809573.091379:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809573.091385:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cec00, rc 0) 00000100:00100000:0.0:1780809573.091431:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:141754:x1867312334915712:12345-192.168.203.33@tcp:101:dd.0 Request processed in 694us (804us total) trans 55834578441 rc 0/0 00000100:00100000:0.0:1780809573.091436:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7381 00000100:00100000:3.0:1780809573.092701:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.092733:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334915840 00000100:00100000:0.0:1780809573.092739:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334915840 00000100:00100000:0.0:1780809573.092766:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2084 00000100:00100000:0.0:1780809573.092770:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01281050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2394:x1867312334915840:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809573.092777:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809573.092788:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2ab5 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871edf expref: 42 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.092800:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809573.092804:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809573.092826:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01281050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2394:x1867312334915840:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809573.092833:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2084 00000100:00100000:2.0:1780809573.126295:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.126350:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334915968 00000100:00100000:1.0:1780809573.126359:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334915968 00000100:00100000:1.0:1780809573.126400:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7382 00000100:00100000:1.0:1780809573.126407:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:141760:x1867312334915968:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809573.126425:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809573.126440:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ee6 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126506:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126517:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126525:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126538:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126543:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126547:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126872:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126889:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 42 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126898:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126927:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 42 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.126937:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 42 pid: 77628 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809573.126947:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338732800:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809573.127006:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded298f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780809573.127772:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338732800:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809573.127787:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809573.127904:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.127976:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334916224 00000100:00100000:0.0:1780809573.127982:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334916224 00000100:00100000:0.0:1780809573.128014:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1707 00000100:00100000:0.0:1780809573.128023:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:89645:x1867312334916224:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809573.128189:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:89645:x1867312334916224:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 167us (283us total) trans 55834578442 rc 0/0 00000100:00100000:0.0:1780809573.128197:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1707 00000100:00100000:3.0:1780809573.128780:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.128820:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334916352 00000100:00100000:1.0:1780809573.128824:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334916352 00010000:00010000:1.0:1780809573.128843:0:77613:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 44 pid: 77628 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809573.128869:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 495 00000100:00100000:1.0:1780809573.128877:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2393:x1867312334916352:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809573.128886:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809573.128898:0:77613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 44 pid: 77628 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.128909:0:77613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 44 pid: 77628 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.128924:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2a92 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ed8 expref: 44 pid: 77628 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.128948:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809573.128952:0:77613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.128960:0:77613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.128966:0:77613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.128987:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809573.129012:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809573.129013:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2393:x1867312334916352:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 135us (230us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809573.129025:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809573.129031:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 495 00000004:00200000:3.0:1780809573.129049:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809573.129063:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809573.129079:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129097:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129107:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129114:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129121:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129138:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809573.129143:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129152:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129162:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809573.129165:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809573.129168:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129175:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f2aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129186:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129193:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129199:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129204:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809573.129207:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129212:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129230:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f000) 00010000:00010000:3.0:1780809573.129231:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809573.129234:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129238:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f2ad1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129258:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 43 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129265:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 42 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.129269:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809573.129271:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809573.129273:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64400, rc 0) 00000100:00100000:3.0:1780809573.129296:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:141760:x1867312334915968:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2890us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809573.129302:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7382 00000100:00100000:3.0:1780809573.130535:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.130566:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334916608 00000100:00100000:0.0:1780809573.130570:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334916608 00000100:00100000:0.0:1780809573.130611:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7383 00000100:00100000:0.0:1780809573.130622:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:141760:x1867312334916608:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809573.130632:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809573.130641:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871eed expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.130691:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.130702:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 43 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.130707:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.130724:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 43 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.130734:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 43 pid: 77627 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809573.130746:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338732928:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809573.130793:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded3733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809573.131472:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338732928:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809573.131483:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809573.131674:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809573.131718:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334916736 00000100:00100000:2.0:1780809573.131723:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334916736 00010000:00010000:2.0:1780809573.131742:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 44 pid: 77627 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809573.131772:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 496 00000100:00100000:2.0:1780809573.131781:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2394:x1867312334916736:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809573.131790:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809573.131801:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 44 pid: 77627 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.131812:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 44 pid: 77627 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.131824:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ad8 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ee6 expref: 44 pid: 77627 timeout: 1935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.131833:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809573.131836:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.131841:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.131844:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.131858:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809573.131875:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809573.131883:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2394:x1867312334916736:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 104us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809573.131890:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 496 00010000:00010000:0.0:1780809573.131897:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809573.131905:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809573.132024:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.132043:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 43 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.132063:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809573.132066:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809573.132069:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfc00, rc 0) 00000100:00100000:0.0:1780809573.132096:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:141760:x1867312334916608:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1474us (1562us total) trans 55834578443 rc 0/0 00000100:00100000:0.0:1780809573.132103:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7383 00000100:00100000:3.0:1780809573.235728:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780809573.235753:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338733056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780809573.235805:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809573.235851:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338733056 00000100:00100000:1.0:1780809573.235858:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338733056 00000100:00100000:1.0:1780809573.235898:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1780809573.235906:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338733056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780809573.235939:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1780809573.235984:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338733056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809573.235999:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1780809573.236024:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338733056:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1780809573.251151:0:7908:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 55834582257 is committed 00000001:00080000:1.0:1780809573.251190:0:7908:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 55834582260 is committed 00000100:00100000:3.0:1780809573.376386:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.376448:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334916992 00000100:00100000:1.0:1780809573.376457:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334916992 00000100:00100000:1.0:1780809573.376504:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1708 00000100:00100000:1.0:1780809573.376514:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda784c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:141754:x1867312334916992:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809573.376723:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda784c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:141754:x1867312334916992:12345-192.168.203.33@tcp:35:dd.0 Request processed in 209us (341us total) trans 55834578444 rc 0/0 00000100:00100000:1.0:1780809573.376731:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1708 00000100:00100000:2.0:1780809573.384950:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809573.385016:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334917248 00000100:00100000:3.0:1780809573.385025:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334917248 00000100:00100000:3.0:1780809573.385081:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7384 00000100:00100000:3.0:1780809573.385089:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:141767:x1867312334917248:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809573.385107:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809573.385122:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2af4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ef4 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385187:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385201:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385209:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385222:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385229:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385236:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385512:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2b09 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385519:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2b09 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385531:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2b09 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809573.385539:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809573.385626:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385632:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385636:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385639:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809573.385642:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385647:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385659:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809573.385661:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809573.385664:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385668:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2afb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385676:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385691:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385697:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385701:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809573.385704:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385711:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385719:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809573.385722:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809573.385725:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385730:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2b02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385767:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2af4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ef4 expref: 47 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385776:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2b09 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ef4 expref: 46 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.385781:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809573.385783:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809573.385789:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809573.385831:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:141767:x1867312334917248:12345-192.168.203.33@tcp:101:dd.0 Request processed in 743us (889us total) trans 55834578445 rc 0/0 00000100:00100000:3.0:1780809573.385836:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7384 00000100:00100000:3.0:1780809573.387064:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.387106:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334917376 00000100:00100000:0.0:1780809573.387112:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334917376 00000100:00100000:0.0:1780809573.387153:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2085 00000100:00100000:0.0:1780809573.387162:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2393:x1867312334917376:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809573.387172:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809573.387185:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2b09 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ef4 expref: 46 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.387198:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809573.387201:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809573.387229:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2393:x1867312334917376:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809573.387234:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2085 00000100:00100000:2.0:1780809573.658226:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.658278:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334917632 00000100:00100000:0.0:1780809573.658288:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334917632 00000100:00100000:0.0:1780809573.658344:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1709 00000100:00100000:0.0:1780809573.658356:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:141767:x1867312334917632:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809573.658543:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:141767:x1867312334917632:12345-192.168.203.33@tcp:35:dd.0 Request processed in 190us (336us total) trans 55834578446 rc 0/0 00000100:00100000:0.0:1780809573.658549:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1709 00000100:00100000:2.0:1780809573.700300:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.700342:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334917888 00000100:00100000:0.0:1780809573.700351:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334917888 00000100:00100000:0.0:1780809573.700392:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7385 00000100:00100000:0.0:1780809573.700398:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:141782:x1867312334917888:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809573.700416:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809573.700432:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871efb expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700483:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700493:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700501:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700509:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700523:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700527:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700819:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2b2c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700826:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2b2c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700830:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2b2c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809573.700837:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809573.700898:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700903:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700908:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700911:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809573.700914:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700918:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700934:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809573.700935:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809573.700939:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700943:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700956:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700959:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700963:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700966:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809573.700968:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700971:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700974:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:0.0:1780809573.700975:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809573.700977:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.700980:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.701013:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871efb expref: 49 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.701022:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2b2c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871efb expref: 48 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.701027:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809573.701028:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809573.701030:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce600, rc 0) 00000100:00100000:0.0:1780809573.701092:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:141782:x1867312334917888:12345-192.168.203.33@tcp:101:dd.0 Request processed in 692us (797us total) trans 55834578447 rc 0/0 00000100:00100000:0.0:1780809573.701097:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7385 00000100:00100000:3.0:1780809573.702092:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.702127:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334918016 00000100:00100000:1.0:1780809573.702131:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334918016 00000100:00100000:1.0:1780809573.702159:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2086 00000100:00100000:1.0:1780809573.702164:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2394:x1867312334918016:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809573.702172:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809573.702182:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f2b2c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871efb expref: 48 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.702193:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809573.702196:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809573.702222:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2394:x1867312334918016:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809573.702226:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2086 00000100:00100000:2.0:1780809573.861250:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.861298:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334918144 00000100:00100000:0.0:1780809573.861307:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334918144 00000100:00100000:0.0:1780809573.861352:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7386 00000100:00100000:0.0:1780809573.861359:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:141788:x1867312334918144:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809573.861377:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809573.861393:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2b3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f02 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861456:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861467:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861475:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861489:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861493:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861497:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861757:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861765:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 48 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861769:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861792:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 48 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.861800:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 48 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809573.861809:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338733184:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809573.861865:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded373480 going to sleep for 11 seconds 00000100:00100000:0.0:1780809573.862662:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338733184:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809573.862681:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809573.862718:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.862772:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334918400 00000100:00100000:1.0:1780809573.862777:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334918400 00000100:00100000:1.0:1780809573.862810:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1710 00000100:00100000:1.0:1780809573.862825:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:89646:x1867312334918400:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809573.862966:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:89646:x1867312334918400:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 143us (249us total) trans 55834578448 rc 0/0 00000100:00100000:1.0:1780809573.862973:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1710 00000100:00100000:2.0:1780809573.863628:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.863676:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334918528 00000100:00100000:0.0:1780809573.863681:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334918528 00010000:00010000:0.0:1780809573.863701:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 50 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809573.863728:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 497 00000100:00100000:0.0:1780809573.863736:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2393:x1867312334918528:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809573.863745:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809573.863750:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 50 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.863762:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 50 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.863777:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2ae6 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871eed expref: 50 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.863794:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809573.863798:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.863805:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.863811:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.863829:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809573.863856:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863866:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809573.863867:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2393:x1867312334918528:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 132us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809573.863884:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 497 00000004:00200000:2.0:1780809573.863900:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809573.863905:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809573.863918:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863928:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863937:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863944:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863951:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863957:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809573.863961:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863969:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863978:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809573.863980:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809573.863984:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.863996:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f2b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864009:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864015:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864021:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864026:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809573.864029:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864034:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864041:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83200) 00010000:00010000:2.0:1780809573.864043:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809573.864058:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864064:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f2b48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864092:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f2b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 49 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864116:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 48 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.864124:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809573.864126:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809573.864129:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce800, rc 0) 00000100:00100000:2.0:1780809573.864160:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:141788:x1867312334918144:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2801us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809573.864167:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7386 00000100:00100000:2.0:1780809573.865453:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.865484:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334918784 00000100:00100000:0.0:1780809573.865489:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334918784 00000100:00100000:0.0:1780809573.865513:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7387 00000100:00100000:0.0:1780809573.865517:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:141788:x1867312334918784:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809573.865529:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809573.865540:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f09 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.865610:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.865619:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 49 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.865624:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.865643:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 49 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.865654:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 49 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809573.865665:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338733312:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809573.865714:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded3736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809573.866425:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338733312:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809573.866436:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809573.866563:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809573.866630:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334918912 00000100:00100000:0.0:1780809573.866633:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334918912 00010000:00010000:0.0:1780809573.866648:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 50 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809573.866676:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 498 00000100:00100000:0.0:1780809573.866685:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2394:x1867312334918912:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809573.866695:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809573.866701:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 50 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.866711:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 50 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.866723:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2b4f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f02 expref: 50 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.866738:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809573.866741:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.866748:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.866754:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809573.866783:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809573.866798:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.866806:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809573.866812:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2394:x1867312334918912:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 127us (248us total) trans 0 rc 0/0 00000004:00200000:2.0:1780809573.866817:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:0.0:1780809573.866823:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 498 00010000:00010000:2.0:1780809573.866912:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f2b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 50 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.866924:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 49 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809573.866930:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809573.866931:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809573.866938:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfe00, rc 0) 00000100:00100000:2.0:1780809573.866961:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:141788:x1867312334918784:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1444us (1510us total) trans 55834578449 rc 0/0 00000100:00100000:2.0:1780809573.866966:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7387 00000100:00100000:2.0:1780809573.890960:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809573.891013:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334919168 00000100:00100000:3.0:1780809573.891029:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334919168 00000100:00100000:3.0:1780809573.891082:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7388 00000100:00100000:3.0:1780809573.891093:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:141795:x1867312334919168:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809573.891111:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809573.891127:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2b6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f10 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891189:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891203:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891211:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891220:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891224:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891228:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891514:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2b80 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891521:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2b80 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891525:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2b80 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809573.891534:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809573.891631:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891637:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891642:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891645:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809573.891648:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891653:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891661:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809573.891663:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809573.891666:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891676:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891685:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891688:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891691:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891694:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809573.891696:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891699:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891703:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809573.891704:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809573.891706:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891709:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891736:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2b6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f10 expref: 52 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891752:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2b80 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f10 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809573.891757:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809573.891758:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809573.891760:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809573.891804:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:141795:x1867312334919168:12345-192.168.203.33@tcp:101:dd.0 Request processed in 711us (849us total) trans 55834578450 rc 0/0 00000100:00100000:3.0:1780809573.891811:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7388 00000100:00100000:3.0:1780809573.892765:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.892812:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334919296 00000100:00100000:3.0:1780809573.892815:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809573.892818:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334919296 00000100:00100000:0.0:1780809573.892854:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334919552 00000100:00100000:0.0:1780809573.892859:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334919552 00000100:00100000:1.0:1780809573.892864:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2087 00000100:00100000:1.0:1780809573.892874:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2391:x1867312334919296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809573.892894:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809573.892911:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2b80 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f10 expref: 52 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809573.892923:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809573.892927:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809573.892930:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1711 00000100:00100000:0.0:1780809573.892938:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:141795:x1867312334919552:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809573.892957:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2391:x1867312334919296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809573.892963:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2087 00000100:00100000:0.0:1780809573.893068:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:141795:x1867312334919552:12345-192.168.203.33@tcp:35:dd.0 Request processed in 130us (254us total) trans 55834578451 rc 0/0 00000100:00100000:0.0:1780809573.893076:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1711 00010000:00010000:0.0:1780809573.939722:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809574.005665:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809574.005721:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334919808 00000100:00100000:1.0:1780809574.005738:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334919808 00000100:00080000:3.0:1780809574.005793:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780809574.005799:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1712 00000100:00100000:1.0:1780809574.005810:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:141782:x1867312334919808:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809574.006010:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:141782:x1867312334919808:12345-192.168.203.33@tcp:35:dd.0 Request processed in 201us (350us total) trans 55834578452 rc 0/0 00000100:00100000:1.0:1780809574.006018:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1712 00000100:00100000:2.0:1780809574.192573:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809574.192628:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334919936 00000100:00100000:3.0:1780809574.192638:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334919936 00000100:00100000:3.0:1780809574.192678:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7389 00000100:00100000:3.0:1780809574.192686:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:141804:x1867312334919936:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809574.192703:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809574.192718:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f17 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.192776:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.192790:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.192818:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.192830:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.192835:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.192839:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.193067:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.193076:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 53 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.193081:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.193104:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 53 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.193120:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 53 pid: 78216 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809574.193132:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cae01ba4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338733440:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809574.193190:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc8aa0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780809574.193945:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cae01ba4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338733440:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809574.194010:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809574.194058:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.194094:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334920192 00000100:00100000:0.0:1780809574.194153:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334920192 00000100:00100000:0.0:1780809574.194182:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1713 00000100:00100000:0.0:1780809574.194189:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:89646:x1867312334920192:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809574.194337:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:89646:x1867312334920192:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 147us (277us total) trans 55834578453 rc 0/0 00000100:00100000:0.0:1780809574.194345:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1713 00000100:00100000:3.0:1780809574.194965:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.195006:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334920320 00000100:00100000:0.0:1780809574.195011:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334920320 00010000:00010000:0.0:1780809574.195033:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 55 pid: 78216 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.195075:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 499 00000100:00100000:0.0:1780809574.195082:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2393:x1867312334920320:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809574.195092:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809574.195099:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 55 pid: 78216 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.195110:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 55 pid: 78216 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.195127:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2b5d lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f09 expref: 55 pid: 78216 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.195152:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.195157:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.195165:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.195172:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.195191:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809574.195217:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2393:x1867312334920320:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 135us (252us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809574.195224:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.195225:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 499 00010000:00010000:3.0:1780809574.195233:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809574.195259:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809574.195263:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809574.195277:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195294:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195304:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195311:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195317:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195324:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809574.195328:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195336:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195345:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809574.195348:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809574.195358:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195364:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2b95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195375:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195381:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195387:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195392:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809574.195395:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195401:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195409:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809574.195412:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809574.195414:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195420:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2b9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195445:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 54 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195469:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 53 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.195478:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809574.195480:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809574.195482:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809574.195521:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:141804:x1867312334919936:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2835us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809574.195529:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7389 00000100:00100000:3.0:1780809574.196845:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809574.196884:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334920576 00000100:00100000:2.0:1780809574.196890:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334920576 00000100:00100000:2.0:1780809574.196925:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7390 00000100:00100000:2.0:1780809574.196933:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:141804:x1867312334920576:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809574.196943:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809574.196952:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f1e expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.197003:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.197014:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 54 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.197022:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.197054:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 54 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.197066:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 54 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809574.197090:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338733568:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809574.197139:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc719a480 going to sleep for 11 seconds 00000100:00100000:3.0:1780809574.197793:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338733568:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809574.197805:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809574.197951:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.197971:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334920704 00000100:00100000:0.0:1780809574.197975:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334920704 00010000:00010000:0.0:1780809574.197989:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 55 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.198058:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 500 00000100:00100000:0.0:1780809574.198064:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2394:x1867312334920704:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809574.198071:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809574.198075:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 55 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.198083:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 55 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.198094:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ba3 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f17 expref: 55 pid: 77629 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.198102:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.198105:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.198110:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.198113:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.198126:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809574.198149:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.198150:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2394:x1867312334920704:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 85us (197us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809574.198168:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.198169:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 500 00000004:00200000:3.0:1780809574.198191:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809574.198286:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 55 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.198307:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 54 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.198325:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809574.198328:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809574.198330:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:3.0:1780809574.198367:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:141804:x1867312334920576:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1435us (1524us total) trans 55834578454 rc 0/0 00000100:00100000:3.0:1780809574.198374:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7390 00000100:00100000:3.0:1780809574.236113:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.236163:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334920960 00000100:00100000:0.0:1780809574.236172:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334920960 00000100:00100000:0.0:1780809574.236229:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7391 00000100:00100000:0.0:1780809574.236240:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:141811:x1867312334920960:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809574.236261:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809574.236280:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f25 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236353:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236367:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236377:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236391:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236398:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236405:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236799:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f2bd4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236827:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f2bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236835:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f2bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809574.236845:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809574.236929:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236937:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236943:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236949:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.236953:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236961:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236972:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809574.236975:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.236980:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.236986:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237014:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237020:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237025:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237029:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfc00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.237032:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237038:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237058:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83000) 00010000:00010000:0.0:1780809574.237060:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.237063:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237069:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2bcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237109:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f25 expref: 57 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237124:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f2bd4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f25 expref: 56 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.237141:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.237143:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809574.237146:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf400, rc 0) 00000100:00100000:0.0:1780809574.237200:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:141811:x1867312334920960:12345-192.168.203.33@tcp:101:dd.0 Request processed in 962us (1095us total) trans 55834578455 rc 0/0 00000100:00100000:0.0:1780809574.237207:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7391 00000100:00100000:2.0:1780809574.238208:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809574.238249:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334921088 00000100:00100000:1.0:1780809574.238258:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334921088 00000100:00100000:1.0:1780809574.238287:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2088 00000100:00100000:1.0:1780809574.238296:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2393:x1867312334921088:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809574.238307:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809574.238320:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f2bd4 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f25 expref: 56 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809574.238335:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809574.238339:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809574.238367:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2393:x1867312334921088:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809574.238374:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2088 00000100:00100000:0.0:1780809574.259729:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780809574.259743:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338733952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809574.259802:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809574.259815:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3444:1867312338734080:0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.259844:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338734464:0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.259853:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809574.259875:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809574.259899:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338734592:0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.259906:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade5228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338734976:0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.259917:0:82719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338733952 00000100:00100000:1.0:1780809574.259925:0:82719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338733952 00000100:00100000:0.0:1780809574.259931:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809574.259940:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809574.259959:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338735104:0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.259965:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade5229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338735488:0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.259989:0:82719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1780809574.259995:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809574.260005:0:82719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338733952:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809574.260019:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734080 00000100:00100000:0.0:1780809574.260022:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade5228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338735616:0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.260025:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734080 00002000:00000024:1.0:1780809574.260037:0:82719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3566206976 avail 3564109824 00000100:00100000:0.0:1780809574.260069:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809574.260079:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1780809574.260096:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780809574.260102:0:82719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338733952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.260106:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338734208:0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260114:0:82719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1780809574.260128:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734464 00000100:00100000:2.0:1780809574.260133:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734464 00000100:00100000:0.0:1780809574.260138:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809574.260161:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734208 00000100:00100000:0.0:1780809574.260164:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc4995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338734720:0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.260166:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734976 00000100:00100000:1.0:1780809574.260167:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734208 00000100:00100000:2.0:1780809574.260170:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734976 00000100:00100000:0.0:1780809574.260201:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809574.260211:0:78803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1780809574.260211:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734720 00000100:00100000:1.0:1780809574.260217:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734720 00000100:00100000:0.0:1780809574.260223:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade5228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1867312338735232:0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.260224:0:78803:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338734464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260238:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1780809574.260250:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338734208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.260258:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809574.260277:0:78803:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338734464:12345-0@lo:400:kworker.0 Request processed in 55us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.260285:0:78803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1780809574.260295:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1780809574.260303:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338734208:12345-0@lo:400:kworker.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.260314:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338734208:0@lo:400:kworker.0 00000100:00100000:3.0:1780809574.260317:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338734976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260322:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1780809574.260347:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1780809574.260357:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338734720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.260364:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734592 00000100:00100000:0.0:1780809574.260369:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734592 00000100:00100000:3.0:1780809574.260373:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338734976:12345-0@lo:400:kworker.0 Request processed in 58us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809574.260380:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1780809574.260405:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338735104 00000100:00100000:0.0:1780809574.260409:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338735104 00000100:00100000:3.0:1780809574.260410:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3444:x1867312338734080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260412:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338734720:12345-0@lo:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809574.260422:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1780809574.260432:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338735616 00000100:00100000:0.0:1780809574.260436:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338735616 00000100:00100000:3.0:1780809574.260449:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3444:x1867312338734080:12345-0@lo:400:kworker.0 Request processed in 362us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.260453:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338735232 00000100:00100000:0.0:1780809574.260455:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338735232 00000100:00100000:3.0:1780809574.260456:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:1.0:1780809574.260458:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780809574.260465:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780809574.260466:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780809574.260472:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780809574.260472:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338735488 00000100:00100000:0.0:1780809574.260477:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338735488 00000100:00100000:3.0:1780809574.260491:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1780809574.260494:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809574.260511:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338734592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.260527:0:3443:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 55834575018 gen 2 00000100:00100000:1.0:1780809574.260528:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cae01ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338733824:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1780809574.260540:0:3443:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cadfc961c00, transno 55834575018 00000100:00100000:0.0:1780809574.260546:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338733696 00000100:00100000:0.0:1780809574.260550:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338733696 00000100:00100000:3.0:1780809574.260555:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338734592:12345-0@lo:400:kworker.0 Request processed in 47us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.260560:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338734464:0@lo:400:kworker.0 00000100:00100000:3.0:1780809574.260566:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1780809574.260570:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809574.260578:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade5228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338734976:0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.260581:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338733824 00000100:00100000:0.0:1780809574.260585:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338733824 00000100:00100000:3.0:1780809574.260606:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1780809574.260611:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338733952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809574.260617:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338735104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260623:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadff78ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338734336:0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.260645:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1780809574.260653:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338733696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780809574.260661:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1780809574.260664:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809574.260665:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1780809574.260672:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338735104:12345-0@lo:400:kworker.0 Request processed in 58us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.260680:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338733824:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809574.260681:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1780809574.260688:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc4994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338734848:0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.260698:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338733696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809574.260699:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00002000:00000024:2.0:1780809574.260705:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:0.0:1780809574.260706:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1780809574.260709:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338735616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260720:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809574.260741:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1780809574.260748:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338735360:0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.260752:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1867312338735232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809574.260759:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338735616:12345-0@lo:400:kworker.0 Request processed in 50us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.260759:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338733824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.260775:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1780809574.260777:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1780809574.260787:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809574.260794:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1867312338735232:12345-0@lo:400:kworker.0 Request processed in 44us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809574.260797:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338735360 00000100:00100000:3.0:1780809574.260801:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338735360 00000100:00100000:0.0:1780809574.260801:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1780809574.260816:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1780809574.260820:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780809574.260827:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338735488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809574.260828:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1780809574.260837:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338735360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260842:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cae01ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338733824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809574.260866:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338735360:12345-0@lo:400:kworker.0 Request processed in 30us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.260866:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338735488:12345-0@lo:400:kworker.0 Request processed in 43us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809574.260873:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1780809574.260880:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00010000:00080000:1.0:1780809574.260882:0:3442:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cade522bb80 x1867312338735360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780809574.260894:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338735360:0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.260910:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade5229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338735488:0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260928:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734336 00000100:00100000:1.0:1780809574.260939:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734336 00000100:00080000:0.0:1780809574.260941:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780809574.260946:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780809574.260948:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809574.260966:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc4995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338734720:0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260980:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338734848 00000100:00100000:0.0:1780809574.260982:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade5228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1867312338735232:0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.260985:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338734848 00000100:00100000:0.0:1780809574.260998:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338735104:0@lo:400:kworker.0 00010000:00080000:0.0:1780809574.261013:0:3444:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cade5228380 x1867312338735616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780809574.261021:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1780809574.261025:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade5228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338735616:0@lo:400:kworker.0 00000100:00100000:3.0:1780809574.261030:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1780809574.261035:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338734336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.261039:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3444:1867312338734080:0@lo:400:kworker.0 00000100:00100000:3.0:1780809574.261054:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338734848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809574.261062:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338734592:0@lo:400:kworker.0 00000100:00100000:1.0:1780809574.261104:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338734336:12345-0@lo:400:kworker.0 Request processed in 73us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809574.261106:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338734848:12345-0@lo:400:kworker.0 Request processed in 66us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809574.261118:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1780809574.261121:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadff78ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338734336:0@lo:400:kworker.0 00000100:00100000:3.0:1780809574.261124:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1780809574.261137:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc4994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338734848:0@lo:400:kworker.0 00000100:00100000:2.0:1780809574.330554:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809574.330636:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334921216 00000100:00100000:3.0:1780809574.330647:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334921216 00000100:00100000:3.0:1780809574.330703:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7392 00000100:00100000:3.0:1780809574.330713:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:141819:x1867312334921216:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809574.330733:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809574.330763:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f2c expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.330836:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.330850:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.330861:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.330874:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.330880:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.330886:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.331217:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.331229:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 56 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.331238:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.331266:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 56 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.331289:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 56 pid: 80225 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809574.331303:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cae01ba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338735744:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809574.331376:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc8aa0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780809574.332127:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cae01ba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338735744:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809574.332142:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809574.332195:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809574.332228:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334921472 00000100:00100000:1.0:1780809574.332233:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334921472 00000100:00100000:1.0:1780809574.332259:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1714 00000100:00100000:1.0:1780809574.332264:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda785850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:89645:x1867312334921472:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809574.332391:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda785850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:89645:x1867312334921472:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 127us (195us total) trans 55834578456 rc 0/0 00000100:00100000:1.0:1780809574.332396:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1714 00000100:00100000:3.0:1780809574.332967:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.333004:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334921600 00000100:00100000:0.0:1780809574.333008:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334921600 00010000:00010000:0.0:1780809574.333028:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 58 pid: 80225 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.333063:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 501 00000100:00100000:0.0:1780809574.333072:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2394:x1867312334921600:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809574.333086:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809574.333091:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 58 pid: 80225 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.333099:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 58 pid: 80225 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.333111:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2bb1 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f1e expref: 58 pid: 80225 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.333130:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.333133:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.333138:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.333142:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.333158:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809574.333179:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2394:x1867312334921600:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.333185:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 501 00010000:00010000:2.0:1780809574.333194:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333202:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809574.333223:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809574.333227:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809574.333236:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333244:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333263:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333268:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333272:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333275:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809574.333278:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333282:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333288:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809574.333290:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809574.333292:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333296:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333302:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333309:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333315:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333325:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809574.333329:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333335:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333343:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:2.0:1780809574.333346:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809574.333357:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333363:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2bf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333385:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 57 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333392:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 56 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.333397:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809574.333399:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809574.333400:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:2.0:1780809574.333424:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:141819:x1867312334921216:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2714us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.333428:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7392 00000100:00100000:3.0:1780809574.334666:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.334698:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334921856 00000100:00100000:0.0:1780809574.334702:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334921856 00000100:00100000:0.0:1780809574.334731:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7393 00000100:00100000:0.0:1780809574.334738:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:141819:x1867312334921856:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809574.334759:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809574.334770:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f33 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.334813:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.334821:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 57 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.334826:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.334841:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 57 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.334849:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 57 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.334855:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338735872:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809574.334887:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded3736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809574.335635:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338735872:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809574.335650:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809574.335813:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.335881:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334921984 00000100:00100000:0.0:1780809574.335885:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334921984 00010000:00010000:0.0:1780809574.335896:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 58 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.335919:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 502 00000100:00100000:0.0:1780809574.335923:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2394:x1867312334921984:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809574.335930:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809574.335933:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 58 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.335940:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 58 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.335948:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2bf7 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f2c expref: 58 pid: 77628 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.335957:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.335959:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.335964:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.335968:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.335980:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809574.336001:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2394:x1867312334921984:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 77us (190us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809574.336007:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.336012:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 502 00010000:00010000:3.0:1780809574.336021:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809574.336032:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809574.336123:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f2bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 58 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.336144:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 57 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.336152:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809574.336155:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809574.336158:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfc00, rc 0) 00000100:00100000:3.0:1780809574.336186:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:141819:x1867312334921856:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1449us (1521us total) trans 55834578457 rc 0/0 00000100:00100000:3.0:1780809574.336203:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7393 00000100:00100000:3.0:1780809574.336374:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.336396:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334922240 00000100:00100000:0.0:1780809574.336405:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334922240 00000100:00100000:0.0:1780809574.336425:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7394 00000100:00100000:0.0:1780809574.336431:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:141823:x1867312334922240:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809574.336437:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809574.336443:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f3a expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336471:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336479:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336487:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336499:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336505:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336512:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336777:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2c28 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336785:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2c28 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336790:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2c28 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809574.336799:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809574.336832:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336836:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336840:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336843:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.336845:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336850:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336855:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809574.336856:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.336858:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336862:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336869:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336872:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336884:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336889:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cee00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.336892:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336897:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336905:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83000) 00010000:00010000:0.0:1780809574.336907:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.336910:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336916:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336941:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f3a expref: 60 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336949:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2c28 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f3a expref: 59 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.336954:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.336955:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809574.336957:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce200, rc 0) 00000100:00100000:0.0:1780809574.336979:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:141823:x1867312334922240:12345-192.168.203.33@tcp:101:dd.0 Request processed in 549us (606us total) trans 55834578458 rc 0/0 00000100:00100000:0.0:1780809574.336989:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7394 00000100:00100000:2.0:1780809574.338143:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809574.338186:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334922368 00000100:00100000:1.0:1780809574.338190:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334922368 00000100:00100000:1.0:1780809574.338213:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2089 00000100:00100000:1.0:1780809574.338218:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2394:x1867312334922368:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809574.338224:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809574.338233:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2c28 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f3a expref: 59 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809574.338242:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809574.338244:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809574.338264:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2394:x1867312334922368:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809574.338276:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2089 00000100:00100000:2.0:1780809574.338341:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.338403:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334922624 00000100:00100000:0.0:1780809574.338407:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334922624 00000100:00100000:0.0:1780809574.338437:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1715 00000100:00100000:0.0:1780809574.338445:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:141823:x1867312334922624:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809574.338551:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:141823:x1867312334922624:12345-192.168.203.33@tcp:35:dd.0 Request processed in 106us (210us total) trans 55834578459 rc 0/0 00000100:00100000:0.0:1780809574.338558:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1715 00000100:00100000:3.0:1780809574.487689:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.487730:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334922880 00000100:00100000:0.0:1780809574.487738:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334922880 00000100:00100000:0.0:1780809574.487780:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7395 00000100:00100000:0.0:1780809574.487786:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:141831:x1867312334922880:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809574.487804:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809574.487819:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f41 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.487871:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.487881:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.487889:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.487897:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.487914:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.487919:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488313:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2c4b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488323:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2c4b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488329:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2c4b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809574.488338:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809574.488421:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488428:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488434:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488439:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cee00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.488443:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488449:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488469:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809574.488472:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.488477:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488482:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488497:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488503:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488508:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488513:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.488515:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488520:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488526:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83000) 00010000:00010000:0.0:1780809574.488529:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.488531:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488536:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488585:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f41 expref: 62 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488644:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2c4b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f41 expref: 61 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.488651:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.488654:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809574.488657:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce000, rc 0) 00000100:00100000:0.0:1780809574.488718:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:141831:x1867312334922880:12345-192.168.203.33@tcp:101:dd.0 Request processed in 930us (1033us total) trans 55834578460 rc 0/0 00000100:00100000:0.0:1780809574.488726:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7395 00000100:00100000:2.0:1780809574.489758:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809574.489780:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.489795:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334923008 00000100:00100000:0.0:1780809574.489801:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334923008 00000100:00100000:1.0:1780809574.489829:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334923264 00000100:00100000:1.0:1780809574.489834:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334923264 00000100:00100000:0.0:1780809574.489844:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2090 00000100:00100000:0.0:1780809574.489856:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01280450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:2392:x1867312334923008:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809574.489868:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1716 00010000:00010000:0.0:1780809574.489871:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780809574.489880:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:141831:x1867312334923264:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:0.0:1780809574.489888:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2c4b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f41 expref: 62 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.489904:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.489907:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809574.489937:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01280450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2392:x1867312334923008:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 85us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.489945:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2090 00000100:00100000:1.0:1780809574.490001:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:141831:x1867312334923264:12345-192.168.203.33@tcp:35:dd.0 Request processed in 124us (217us total) trans 55834578461 rc 0/0 00000100:00100000:1.0:1780809574.490009:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1716 00000100:00100000:2.0:1780809574.538163:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.538230:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334923520 00000100:00100000:0.0:1780809574.538240:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334923520 00000100:00100000:0.0:1780809574.538296:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1717 00000100:00100000:0.0:1780809574.538307:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:141811:x1867312334923520:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809574.538492:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:141811:x1867312334923520:12345-192.168.203.33@tcp:35:dd.0 Request processed in 188us (338us total) trans 55834578462 rc 0/0 00000100:00100000:0.0:1780809574.538498:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1717 00000100:00100000:3.0:1780809574.631737:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.631791:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334923776 00000100:00100000:0.0:1780809574.631801:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334923776 00000100:00100000:0.0:1780809574.631856:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7396 00000100:00100000:0.0:1780809574.631868:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:141846:x1867312334923776:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809574.631890:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809574.631911:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2c59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f48 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.631986:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632001:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632012:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632026:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632033:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632069:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632436:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c6e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632446:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c6e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632453:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c6e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809574.632464:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809574.632542:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632550:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632556:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632562:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.632565:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632570:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632578:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809574.632580:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.632611:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632618:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632637:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632643:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632649:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632655:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809574.632658:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632664:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632671:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83000) 00010000:00010000:0.0:1780809574.632673:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809574.632676:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632682:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2c67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632720:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2c59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f48 expref: 65 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632748:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c6e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f48 expref: 64 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.632755:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.632758:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809574.632760:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cee00, rc 0) 00000100:00100000:0.0:1780809574.632809:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:141846:x1867312334923776:12345-192.168.203.33@tcp:101:dd.0 Request processed in 943us (1077us total) trans 55834578463 rc 0/0 00000100:00100000:0.0:1780809574.632817:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7396 00000100:00100000:2.0:1780809574.633759:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.633787:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334923904 00000100:00100000:0.0:1780809574.633791:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334923904 00000100:00100000:0.0:1780809574.633818:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2091 00000100:00100000:0.0:1780809574.633822:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2393:x1867312334923904:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809574.633829:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809574.633840:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2c6e lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f48 expref: 64 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.633850:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.633853:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809574.633879:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2393:x1867312334923904:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.633884:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2091 00000100:00100000:2.0:1780809574.768407:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809574.768473:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334924160 00000100:00100000:3.0:1780809574.768482:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334924160 00000100:00100000:3.0:1780809574.768535:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7397 00000100:00100000:3.0:1780809574.768546:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:141852:x1867312334924160:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809574.768569:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809574.768618:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f4f expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.768685:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.768698:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.768711:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.768723:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.768742:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.768752:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769110:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2c91 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769120:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2c91 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769127:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2c91 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809574.769136:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809574.769224:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769232:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769238:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769243:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809574.769248:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769255:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769266:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809574.769269:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809574.769273:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769288:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769300:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769306:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769312:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769316:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809574.769319:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769324:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769330:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:3.0:1780809574.769333:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809574.769335:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769340:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2c8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769374:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f4f expref: 66 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769396:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2c91 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f4f expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809574.769402:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809574.769404:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809574.769407:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809574.769458:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:141852:x1867312334924160:12345-192.168.203.33@tcp:101:dd.0 Request processed in 914us (1058us total) trans 55834578464 rc 0/0 00000100:00100000:3.0:1780809574.769466:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7397 00000100:00100000:3.0:1780809574.770584:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809574.770632:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334924288 00000100:00100000:1.0:1780809574.770638:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334924288 00000100:00100000:3.0:1780809574.770643:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809574.770680:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2092 00000100:00100000:1.0:1780809574.770689:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312334924288:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809574.770700:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809574.770713:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2c91 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f4f expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809574.770725:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809574.770729:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809574.770760:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2393:x1867312334924288:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809574.770767:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2092 00000100:00100000:2.0:1780809574.770826:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334924544 00000100:00100000:2.0:1780809574.770830:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334924544 00000100:00100000:2.0:1780809574.770857:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1718 00000100:00100000:2.0:1780809574.770864:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:141852:x1867312334924544:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809574.770974:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:141852:x1867312334924544:12345-192.168.203.33@tcp:35:dd.0 Request processed in 110us (331us total) trans 55834578465 rc 0/0 00000100:00100000:2.0:1780809574.770981:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1718 00000100:00100000:1.0:1780809574.771704:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cae01ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338736000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780809574.771741:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809574.771793:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338736000 00000100:00100000:2.0:1780809574.771798:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338736000 00000100:00100000:2.0:1780809574.771827:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1780809574.771834:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338736000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780809574.771854:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:2.0:1780809574.771894:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338736000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.771901:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1780809574.771922:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cae01ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338736000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780809574.951097:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.951144:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334924800 00000100:00100000:0.0:1780809574.951154:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334924800 00000100:00100000:0.0:1780809574.951202:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1719 00000100:00100000:0.0:1780809574.951224:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:141846:x1867312334924800:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809574.951429:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:141846:x1867312334924800:12345-192.168.203.33@tcp:35:dd.0 Request processed in 207us (336us total) trans 55834578466 rc 0/0 00000100:00100000:0.0:1780809574.951438:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1719 00010000:00010000:1.0:1780809574.963801:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809574.973801:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809574.973863:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334924928 00000100:00100000:2.0:1780809574.973872:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334924928 00000100:00100000:2.0:1780809574.973923:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7398 00000100:00100000:2.0:1780809574.973933:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:141860:x1867312334924928:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809574.973955:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809574.973986:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f56 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974072:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974088:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974098:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974110:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974117:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974124:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974440:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974452:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 67 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974460:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974489:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 67 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.974511:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 67 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809574.974524:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338736128:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809574.974617:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc719af00 going to sleep for 11 seconds 00000100:00100000:2.0:1780809574.975334:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338736128:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809574.975352:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809574.975722:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809574.975766:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334925184 00000100:00100000:2.0:1780809574.975771:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334925184 00000100:00100000:2.0:1780809574.975802:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1720 00000100:00100000:2.0:1780809574.975812:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:89645:x1867312334925184:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809574.975956:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:89645:x1867312334925184:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 146us (233us total) trans 55834578467 rc 0/0 00000100:00100000:2.0:1780809574.975965:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1720 00000100:00100000:3.0:1780809574.976604:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.976632:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334925312 00000100:00100000:0.0:1780809574.976638:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334925312 00010000:00010000:0.0:1780809574.976661:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 69 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.976686:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 503 00000100:00100000:0.0:1780809574.976693:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:2393:x1867312334925312:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809574.976702:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809574.976708:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 69 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.976719:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 69 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.976734:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2c05 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f33 expref: 69 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.976757:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.976765:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.976772:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.976787:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.976806:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809574.976831:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2393:x1867312334925312:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 138us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809574.976840:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 503 00010000:00010000:2.0:1780809574.976845:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976855:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809574.976880:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809574.976885:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809574.976896:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976913:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976919:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976925:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976932:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976938:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809574.976942:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976949:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976957:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809574.976960:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809574.976964:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976970:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976991:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.976998:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977009:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977012:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809574.977014:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977019:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977027:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54000) 00010000:00010000:2.0:1780809574.977051:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809574.977055:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977065:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2cad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977102:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 68 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977118:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 67 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.977126:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809574.977127:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809574.977129:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ec00, rc 0) 00000100:00100000:2.0:1780809574.977156:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:141860:x1867312334924928:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3224us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809574.977171:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7398 00000100:00100000:3.0:1780809574.978279:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.978313:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334925568 00000100:00100000:0.0:1780809574.978318:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334925568 00000100:00100000:0.0:1780809574.978355:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7399 00000100:00100000:0.0:1780809574.978361:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:141860:x1867312334925568:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809574.978369:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809574.978376:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2cbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f5d expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.978419:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.978426:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 68 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.978432:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.978445:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 68 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.978451:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 68 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809574.978468:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338736256:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809574.978504:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc4dd2180 going to sleep for 11 seconds 00000100:00100000:0.0:1780809574.979100:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338736256:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809574.979109:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809574.979374:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809574.979395:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334925696 00000100:00100000:0.0:1780809574.979399:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334925696 00010000:00010000:0.0:1780809574.979412:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 69 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809574.979456:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 504 00000100:00100000:2.0:1780809574.979464:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:2394:x1867312334925696:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809574.979471:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809574.979476:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 69 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.979485:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 69 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.979494:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2cb4 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f56 expref: 69 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.979505:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809574.979507:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.979512:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.979516:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809574.979530:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809574.979543:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809574.979552:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2394:x1867312334925696:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 89us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809574.979555:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809574.979560:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 504 00000004:00200000:0.0:1780809574.979569:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809574.979661:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2cbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 69 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.979672:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809574.979679:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809574.979720:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809574.979730:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce000, rc 0) 00000100:00100000:0.0:1780809574.979757:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:141860:x1867312334925568:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1395us (1479us total) trans 55834578468 rc 0/0 00000100:00100000:0.0:1780809574.979761:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7399 00000100:00100000:3.0:1780809575.180288:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.180342:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334925952 00000100:00100000:0.0:1780809575.180351:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334925952 00000100:00100000:0.0:1780809575.180408:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7400 00000100:00100000:0.0:1780809575.180420:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:141867:x1867312334925952:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809575.180442:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809575.180462:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f64 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.180559:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.180578:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.180608:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.180624:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.180631:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.180638:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181023:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2ce5 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181050:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2ce5 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181059:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2ce5 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809575.181069:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809575.181155:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181163:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181170:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181176:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfc00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.181180:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181188:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181200:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809575.181203:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.181208:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181214:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181243:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181249:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181255:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181260:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.181263:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181269:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181277:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83000) 00010000:00010000:0.0:1780809575.181279:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.181282:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181288:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181328:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f64 expref: 71 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181343:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2ce5 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f64 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.181362:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809575.181364:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809575.181366:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce800, rc 0) 00000100:00100000:0.0:1780809575.181421:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:141867:x1867312334925952:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1004us (1137us total) trans 55834578469 rc 0/0 00000100:00100000:0.0:1780809575.181428:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7400 00000100:00100000:3.0:1780809575.183667:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809575.183717:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334926080 00000100:00100000:1.0:1780809575.183724:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334926080 00000100:00100000:1.0:1780809575.183768:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2093 00000100:00100000:1.0:1780809575.183777:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:2393:x1867312334926080:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809575.183789:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809575.183806:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2ce5 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f64 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809575.183824:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809575.183828:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809575.183865:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:2393:x1867312334926080:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809575.183872:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2093 00000100:00100000:3.0:1780809575.209054:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.209112:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334926208 00000100:00100000:0.0:1780809575.209122:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334926208 00000100:00100000:0.0:1780809575.209185:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7401 00000100:00100000:0.0:1780809575.209195:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:141873:x1867312334926208:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809575.209214:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809575.209232:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f6b expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209289:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209300:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209309:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209322:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209329:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209349:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209677:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209686:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 70 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209691:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209715:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 70 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.209725:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 70 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809575.209739:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338736384:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809575.209805:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc4dd2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780809575.210815:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.210861:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338736384:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809575.210872:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334926464 00000100:00100000:1.0:1780809575.210878:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334926464 00010000:00010000:0.0:1780809575.210880:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809575.210915:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1721 00000100:00100000:1.0:1780809575.210923:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:89645:x1867312334926464:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809575.211094:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:89645:x1867312334926464:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 171us (277us total) trans 55834578470 rc 0/0 00000100:00100000:1.0:1780809575.211102:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1721 00000100:00100000:3.0:1780809575.211912:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.211953:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334926592 00000100:00100000:0.0:1780809575.211958:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334926592 00010000:00010000:0.0:1780809575.211977:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 72 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809575.212027:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 505 00000100:00100000:0.0:1780809575.212034:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2394:x1867312334926592:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809575.212056:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809575.212062:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 72 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.212074:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 72 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.212091:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2cc2 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f5d expref: 72 pid: 77627 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.212109:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809575.212113:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.212121:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.212127:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.212151:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809575.212181:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2394:x1867312334926592:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 148us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809575.212188:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 505 00010000:00010000:3.0:1780809575.212261:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212269:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809575.212300:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809575.212304:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809575.212316:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212326:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212335:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212341:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212348:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212354:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809575.212359:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212367:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212377:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809575.212380:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809575.212383:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212389:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212412:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212419:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212425:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212430:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfc00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809575.212432:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212439:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212446:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83000) 00010000:00010000:3.0:1780809575.212448:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809575.212451:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212456:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212484:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 71 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212497:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 70 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.212514:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809575.212516:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809575.212519:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfa00, rc 0) 00000100:00100000:3.0:1780809575.212551:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:141873:x1867312334926208:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3357us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809575.212558:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7401 00000100:00100000:3.0:1780809575.214402:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.214476:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334926848 00000100:00100000:0.0:1780809575.214487:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334926848 00000100:00100000:0.0:1780809575.214556:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7402 00000100:00100000:0.0:1780809575.214564:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:141873:x1867312334926848:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809575.214579:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809575.214609:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f72 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.214673:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.214684:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 71 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.214692:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.214714:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 71 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.214734:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 71 pid: 80225 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809575.214747:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338736512:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809575.214801:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc4dd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780809575.215584:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc1f77100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338736512:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809575.215609:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809575.216282:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.216441:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334926976 00000100:00100000:2.0:1780809575.216446:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334926976 00010000:00010000:2.0:1780809575.216468:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 72 pid: 80225 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.216670:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 506 00000100:00100000:2.0:1780809575.216679:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01283050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2393:x1867312334926976:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809575.216689:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809575.216695:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 72 pid: 80225 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.216707:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 72 pid: 80225 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.216724:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d08 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f6b expref: 72 pid: 80225 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.216741:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809575.216745:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.216753:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.216759:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.216781:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809575.216801:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.216811:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.216817:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01283050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2393:x1867312334926976:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 137us (534us total) trans 0 rc 0/0 00000004:00200000:0.0:1780809575.216827:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809575.216837:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 506 00010000:00010000:0.0:1780809575.216940:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 72 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.216956:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.216962:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809575.216965:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809575.216967:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce400, rc 0) 00000100:00100000:0.0:1780809575.217001:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:141873:x1867312334926848:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2438us (2601us total) trans 55834578471 rc 0/0 00000100:00100000:0.0:1780809575.217009:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7402 00000100:00100000:3.0:1780809575.224859:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.224905:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334927232 00000100:00100000:0.0:1780809575.224914:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334927232 00000100:00100000:0.0:1780809575.224967:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7403 00000100:00100000:0.0:1780809575.224978:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:141879:x1867312334927232:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809575.224999:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809575.225017:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f79 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225114:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225127:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225138:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225151:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225159:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225166:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225527:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d39 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225537:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d39 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225545:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d39 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809575.225554:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809575.225664:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225681:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225688:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225694:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.225698:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225706:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225718:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809575.225722:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.225727:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225733:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225751:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225758:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225765:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225770:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cee00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.225780:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225787:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225795:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809575.225797:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.225801:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225807:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225845:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f79 expref: 74 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225861:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d39 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f79 expref: 73 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.225868:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809575.225871:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809575.225874:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfc00, rc 0) 00000100:00100000:0.0:1780809575.225926:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:141879:x1867312334927232:12345-192.168.203.33@tcp:101:dd.0 Request processed in 950us (1075us total) trans 55834578472 rc 0/0 00000100:00100000:0.0:1780809575.225935:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7403 00000100:00100000:1.0:1780809575.227023:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809575.227063:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809575.227077:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334927360 00000100:00100000:3.0:1780809575.227082:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334927360 00000100:00100000:2.0:1780809575.227111:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334927616 00000100:00100000:2.0:1780809575.227118:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334927616 00000100:00100000:3.0:1780809575.227122:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2094 00000100:00100000:3.0:1780809575.227134:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2394:x1867312334927360:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780809575.227145:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780809575.227158:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f2d39 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f79 expref: 74 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.227168:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1722 00010000:00010000:3.0:1780809575.227173:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809575.227178:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809575.227180:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:141879:x1867312334927616:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809575.227211:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2394:x1867312334927360:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809575.227218:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2094 00000100:00100000:2.0:1780809575.227317:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:141879:x1867312334927616:12345-192.168.203.33@tcp:35:dd.0 Request processed in 140us (253us total) trans 55834578473 rc 0/0 00000100:00100000:2.0:1780809575.227325:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1722 00000100:00100000:0.0:1780809575.283752:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338736640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780809575.283808:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809575.283841:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338736640 00000100:00100000:2.0:1780809575.283849:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338736640 00000100:00100000:2.0:1780809575.283891:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1780809575.283901:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338736640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780809575.283924:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809575.283969:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338736640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809575.283975:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1780809575.283999:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338736640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809575.498755:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.498806:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334927872 00000100:00100000:0.0:1780809575.498815:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334927872 00000100:00100000:0.0:1780809575.498870:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1723 00000100:00100000:0.0:1780809575.498880:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:141867:x1867312334927872:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809575.499104:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:141867:x1867312334927872:12345-192.168.203.33@tcp:35:dd.0 Request processed in 225us (354us total) trans 55834578474 rc 0/0 00000100:00100000:0.0:1780809575.499112:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1723 00000100:00100000:1.0:1780809575.543357:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.543413:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334928000 00000100:00100000:2.0:1780809575.543421:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334928000 00000100:00100000:2.0:1780809575.543463:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7404 00000100:00100000:2.0:1780809575.543470:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:141888:x1867312334928000:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809575.543488:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809575.543503:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2d47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f80 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543549:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543571:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543579:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543611:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543616:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543620:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543874:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543881:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 75 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543887:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543909:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 75 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.543919:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 75 pid: 79214 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.543935:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338736768:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809575.543993:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780809575.544710:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338736768:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809575.544722:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809575.544906:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.544954:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334928256 00000100:00100000:2.0:1780809575.544959:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334928256 00000100:00100000:2.0:1780809575.544987:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1724 00000100:00100000:2.0:1780809575.544992:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:90168:x1867312334928256:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809575.545143:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:90168:x1867312334928256:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 150us (237us total) trans 55834578475 rc 0/0 00000100:00100000:2.0:1780809575.545148:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1724 00000100:00100000:3.0:1780809575.545747:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.545792:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334928384 00000100:00100000:2.0:1780809575.545798:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334928384 00010000:00010000:2.0:1780809575.545817:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 77 pid: 79214 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.545844:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 507 00000100:00100000:2.0:1780809575.545853:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2393:x1867312334928384:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809575.545862:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809575.545868:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 77 pid: 79214 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.545890:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 77 pid: 79214 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.545905:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f2d16 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f72 expref: 77 pid: 79214 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.545923:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809575.545928:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.545936:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.545942:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.545962:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809575.545983:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.545991:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:2393:x1867312334928384:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 137us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809575.546001:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 507 00010000:00010000:3.0:1780809575.546012:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809575.546048:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809575.546053:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809575.546067:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546076:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546082:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546087:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546091:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546094:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809575.546097:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546101:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546107:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809575.546110:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809575.546113:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546129:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546152:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546159:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546165:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546170:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809575.546173:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546179:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546187:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54000) 00010000:00010000:3.0:1780809575.546188:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809575.546190:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546194:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2d55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546230:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2d47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 76 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546259:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 75 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.546267:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809575.546269:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809575.546271:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:3.0:1780809575.546302:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:141888:x1867312334928000:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2831us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809575.546309:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7404 00000100:00100000:3.0:1780809575.547563:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.547626:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334928640 00000100:00100000:0.0:1780809575.547630:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334928640 00000100:00100000:0.0:1780809575.547653:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7405 00000100:00100000:0.0:1780809575.547659:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:141888:x1867312334928640:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809575.547669:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809575.547677:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f87 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.547719:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.547726:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 76 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.547731:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.547745:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 76 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.547752:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 76 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809575.547764:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc1f76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338736896:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809575.547797:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc4dd2180 going to sleep for 11 seconds 00000100:00100000:0.0:1780809575.548474:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc1f76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338736896:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809575.548542:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809575.548582:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.548637:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334928768 00000100:00100000:2.0:1780809575.548641:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334928768 00010000:00010000:2.0:1780809575.548658:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 77 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.548685:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 508 00000100:00100000:2.0:1780809575.548693:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2394:x1867312334928768:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809575.548712:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809575.548717:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 77 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.548728:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 77 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.548740:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2d5c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f80 expref: 77 pid: 77628 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.548756:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809575.548759:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.548766:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.548772:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.548789:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809575.548806:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.548812:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.548819:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:2394:x1867312334928768:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 124us (234us total) trans 0 rc 0/0 00000004:00200000:0.0:1780809575.548824:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809575.548831:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 508 00010000:00010000:0.0:1780809575.548903:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.548921:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 76 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.548928:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809575.548931:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809575.548969:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cee00, rc 0) 00000100:00100000:0.0:1780809575.548994:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:141888:x1867312334928640:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1335us (1433us total) trans 55834578476 rc 0/0 00000100:00100000:0.0:1780809575.548998:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7405 00000100:00100000:3.0:1780809575.670663:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.670708:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334929024 00000100:00100000:0.0:1780809575.670733:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334929024 00000100:00100000:0.0:1780809575.670776:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7406 00000100:00100000:0.0:1780809575.670785:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:141902:x1867312334929024:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809575.670804:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809575.670821:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2d78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f8e expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.670877:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.670888:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.670895:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.670903:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.670907:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.670911:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671206:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2d8d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671213:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2d8d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671217:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2d8d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809575.671230:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809575.671295:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671300:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671304:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671307:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.671310:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671315:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671323:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809575.671325:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.671328:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671332:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671345:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671349:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671359:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671363:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.671364:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671367:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671371:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809575.671373:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.671374:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671377:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2d86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671405:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f8e expref: 79 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671414:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2d8d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f8e expref: 78 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.671419:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809575.671420:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809575.671422:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cea00, rc 0) 00000100:00100000:0.0:1780809575.671463:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:141902:x1867312334929024:12345-192.168.203.33@tcp:101:dd.0 Request processed in 680us (809us total) trans 55834578477 rc 0/0 00000100:00100000:0.0:1780809575.671474:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7406 00000100:00100000:1.0:1780809575.672404:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809575.672445:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334929152 00000100:00100000:3.0:1780809575.672450:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334929152 00000100:00100000:3.0:1780809575.672482:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2095 00000100:00100000:3.0:1780809575.672487:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2392:x1867312334929152:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780809575.672495:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780809575.672505:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f2d8d lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f8e expref: 78 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.672515:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809575.672517:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809575.672542:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2392:x1867312334929152:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809575.672547:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2095 00000100:00100000:1.0:1780809575.824408:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809575.824459:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334929408 00000100:00100000:3.0:1780809575.824466:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334929408 00000100:00100000:3.0:1780809575.824510:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7407 00000100:00100000:3.0:1780809575.824516:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:141908:x1867312334929408:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809575.824535:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809575.824549:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2d9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f95 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.824641:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.824654:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.824666:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.824679:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.824686:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.824693:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825056:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2db0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825066:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2db0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825084:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2db0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809575.825095:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809575.825181:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825189:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825196:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825202:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809575.825207:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825213:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825225:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809575.825228:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809575.825232:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825239:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2da2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825252:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825267:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825273:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825278:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809575.825281:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825287:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825295:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:3.0:1780809575.825298:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809575.825300:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825306:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2da9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825340:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2d9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f95 expref: 80 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825360:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2db0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f95 expref: 79 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.825371:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809575.825373:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809575.825382:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809575.825436:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:141908:x1867312334929408:12345-192.168.203.33@tcp:101:dd.0 Request processed in 918us (1033us total) trans 55834578478 rc 0/0 00000100:00100000:3.0:1780809575.825444:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7407 00000100:00100000:0.0:1780809575.826428:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.826451:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809575.826465:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334929792 00000100:00100000:1.0:1780809575.826470:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334929792 00000100:00100000:2.0:1780809575.826489:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334929536 00000100:00100000:2.0:1780809575.826494:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334929536 00000100:00100000:1.0:1780809575.826501:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1725 00000100:00100000:1.0:1780809575.826511:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:141908:x1867312334929792:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809575.826532:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2096 00000100:00100000:2.0:1780809575.826543:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:2393:x1867312334929536:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809575.826563:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809575.826578:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2db0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f95 expref: 81 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.826616:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809575.826620:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809575.826647:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:2393:x1867312334929536:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 109us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809575.826654:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2096 00000100:00100000:1.0:1780809575.826655:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:141908:x1867312334929792:12345-192.168.203.33@tcp:35:dd.0 Request processed in 145us (225us total) trans 55834578479 rc 0/0 00000100:00100000:1.0:1780809575.826663:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1725 00000100:00100000:1.0:1780809575.933853:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809575.933898:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.933904:0:77620:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334929920 00000100:00100000:0.0:1780809575.933914:0:77620:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334929920 00000100:00100000:1.0:1780809575.933940:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.933960:0:77620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 381 00000100:00100000:3.0:1780809575.933964:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334930048 00000100:00100000:0.0:1780809575.933970:0:77620:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2394:x1867312334929920:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809575.933971:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334930048 00000100:00100000:1.0:1780809575.933980:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.934003:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334930304 00000100:00100000:2.0:1780809575.934008:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334930304 00000100:00100000:3.0:1780809575.934009:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334930176 00000100:00100000:3.0:1780809575.934011:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334930176 00000100:00100000:1.0:1780809575.934020:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809575.934046:0:77620:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2394:x1867312334929920:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809575.934052:0:77620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 381 00000100:00100000:3.0:1780809575.934058:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334930432 00000100:00100000:3.0:1780809575.934063:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334930432 00000100:00100000:2.0:1780809575.934079:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 647 00000100:00100000:2.0:1780809575.934088:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2393:x1867312334930304:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:0.0:1780809575.934089:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780809575.934096:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780809575.934100:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 648 00000100:00080000:0.0:1780809575.934101:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780809575.934112:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334930432:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809575.934133:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1065 00000100:00100000:1.0:1780809575.934137:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.934139:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2393:x1867312334930304:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809575.934143:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334930432:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809575.934148:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2393:x1867312334930048:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809575.934149:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 647 00000100:00100000:3.0:1780809575.934155:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 648 00000100:00100000:1.0:1780809575.934179:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809575.934202:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334930560 00000100:00100000:1.0:1780809575.934207:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334930560 00000100:00100000:2.0:1780809575.934216:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334930688 00000100:00100000:2.0:1780809575.934222:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334930688 00000100:00100000:0.0:1780809575.934224:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2393:x1867312334930048:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809575.934230:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1065 00000100:00100000:1.0:1780809575.934252:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1066 00000100:00100000:2.0:1780809575.934259:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1067 00000100:00100000:1.0:1780809575.934263:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334930176:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809575.934269:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1068 00000100:00100000:2.0:1780809575.934272:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312334930560:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809575.934279:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312334930688:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809575.934298:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2394:x1867312334930176:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00080000:0.0:1780809575.934303:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780809575.934304:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1066 00000100:00080000:0.0:1780809575.934309:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809575.934311:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312334930688:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 30us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809575.934311:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312334930560:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 38us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809575.934320:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1068 00000100:00100000:2.0:1780809575.934328:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1067 00000100:00100000:3.0:1780809575.943479:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.943531:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334930944 00000100:00100000:2.0:1780809575.943540:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334930944 00000100:00100000:2.0:1780809575.943583:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1726 00000100:00100000:2.0:1780809575.943629:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:141902:x1867312334930944:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809575.943832:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:141902:x1867312334930944:12345-192.168.203.33@tcp:35:dd.0 Request processed in 205us (359us total) trans 55834578480 rc 0/0 00000100:00100000:2.0:1780809575.943840:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1726 00000100:00100000:0.0:1780809575.973994:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.974059:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334931072 00000100:00100000:2.0:1780809575.974070:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334931072 00000100:00100000:2.0:1780809575.974136:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7408 00000100:00100000:2.0:1780809575.974147:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:141916:x1867312334931072:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809575.974168:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809575.974188:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871f9c expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974244:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974255:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974263:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974272:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974276:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974280:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974526:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974538:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 81 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974546:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974576:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 81 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.974586:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 81 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.974615:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338737024:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809575.974690:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959840 going to sleep for 11 seconds 00000100:00100000:2.0:1780809575.975494:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338737024:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809575.975513:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809575.975577:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809575.975618:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334931328 00000100:00100000:1.0:1780809575.975623:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334931328 00000100:00100000:1.0:1780809575.975657:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1727 00000100:00100000:1.0:1780809575.975667:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:89646:x1867312334931328:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809575.975822:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:89646:x1867312334931328:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 157us (244us total) trans 55834578481 rc 0/0 00000100:00100000:1.0:1780809575.975832:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1727 00000100:00100000:1.0:1780809575.976527:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.976571:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334931456 00000100:00100000:2.0:1780809575.976575:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334931456 00010000:00010000:2.0:1780809575.976603:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.976622:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 509 00000100:00100000:2.0:1780809575.976633:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2393:x1867312334931456:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809575.976644:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809575.976650:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.976663:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.976679:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f2d6a lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f87 expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.976694:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809575.976697:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.976702:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.976706:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.976723:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809575.976738:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976746:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.976756:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2393:x1867312334931456:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 121us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809575.976765:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 509 00000004:00200000:0.0:1780809575.976774:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809575.976778:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809575.976788:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976796:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976803:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976808:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976815:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976821:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.976825:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976833:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976843:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809575.976846:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.976849:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976855:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976924:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976928:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976932:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976935:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809575.976937:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976940:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976945:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54c00) 00010000:00010000:0.0:1780809575.976946:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809575.976948:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976952:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2dcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976979:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 82 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976987:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 81 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809575.976999:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809575.977000:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809575.977002:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ea00, rc 0) 00000100:00100000:0.0:1780809575.977046:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:141916:x1867312334931072:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2901us (3057us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809575.977053:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7408 00000100:00100000:1.0:1780809575.978463:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809575.978500:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334931712 00000100:00100000:2.0:1780809575.978504:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334931712 00000100:00100000:2.0:1780809575.978529:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7409 00000100:00100000:2.0:1780809575.978534:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:141916:x1867312334931712:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809575.978550:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809575.978559:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fa3 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.978624:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.978636:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 82 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.978644:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.978666:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 82 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.978674:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 82 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809575.978683:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338737152:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809575.978718:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780809575.979395:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338737152:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809575.979409:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809575.979625:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809575.979673:0:77613:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334931840 00000100:00100000:3.0:1780809575.979678:0:77613:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334931840 00010000:00010000:3.0:1780809575.979695:0:77613:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809575.979715:0:77613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 510 00000100:00100000:3.0:1780809575.979726:0:77613:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01282c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2394:x1867312334931840:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780809575.979732:0:77613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780809575.979735:0:77613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.979742:0:77613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.979752:0:77613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dd3 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871f9c expref: 83 pid: 77627 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.979765:0:77613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809575.979767:0:77613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.979774:0:77613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.979780:0:77613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809575.979799:0:77613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809575.979820:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809575.979829:0:77613:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01282c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2394:x1867312334931840:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 100us (203us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809575.979831:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809575.979838:0:77613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 510 00000004:00200000:2.0:1780809575.979852:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809575.979938:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 83 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.979958:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 82 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809575.979965:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809575.979968:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809575.979970:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f200, rc 0) 00000100:00100000:2.0:1780809575.979998:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:141916:x1867312334931712:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1463us (1536us total) trans 55834578482 rc 0/0 00000100:00100000:2.0:1780809575.980005:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7409 00010000:00010000:0.0:1780809575.987674:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809576.075129:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.075192:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334932096 00000100:00100000:2.0:1780809576.075202:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334932096 00000100:00080000:0.0:1780809576.075251:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780809576.075267:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7410 00000100:00100000:2.0:1780809576.075278:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:141923:x1867312334932096:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809576.075302:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809576.075321:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871faa expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075388:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075400:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075420:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075430:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075435:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075439:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075761:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e04 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075768:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e04 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075773:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e04 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809576.075779:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809576.075842:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075847:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075851:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075854:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809576.075861:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075867:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075876:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809576.075878:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809576.075881:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075885:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075903:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075907:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075910:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075913:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809576.075915:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075918:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075921:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54800) 00010000:00010000:2.0:1780809576.075923:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809576.075927:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075931:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2dfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075960:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871faa expref: 85 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075977:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e04 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871faa expref: 84 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.075982:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.075983:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809576.075985:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:2.0:1780809576.076049:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:141923:x1867312334932096:12345-192.168.203.33@tcp:101:dd.0 Request processed in 773us (926us total) trans 55834578483 rc 0/0 00000100:00100000:2.0:1780809576.076055:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7410 00000100:00100000:3.0:1780809576.077163:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.077199:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334932224 00000100:00100000:2.0:1780809576.077203:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334932224 00000100:00100000:2.0:1780809576.077238:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2097 00000100:00100000:2.0:1780809576.077246:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312334932224:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809576.077256:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809576.077270:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e04 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871faa expref: 84 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.077284:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.077287:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809576.077325:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2393:x1867312334932224:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809576.077332:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2097 00000040:00080000:1.0:1780809576.180238:0:77663:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1780809576.314394:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578477 is committed 00000001:00080000:2.0:1780809576.314469:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578481 is committed 00000001:00080000:2.0:1780809576.314506:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578483 is committed 00000100:00100000:1.0:1780809576.362378:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.362429:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334932480 00000100:00100000:2.0:1780809576.362438:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334932480 00000100:00100000:2.0:1780809576.362478:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1728 00000100:00100000:2.0:1780809576.362484:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+17:141923:x1867312334932480:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809576.362704:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:141923:x1867312334932480:12345-192.168.203.33@tcp:35:dd.0 Request processed in 219us (333us total) trans 55834578484 rc 0/0 00000100:00100000:2.0:1780809576.362709:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1728 00000100:00100000:1.0:1780809576.371336:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809576.371388:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334932736 00000100:00100000:0.0:1780809576.371395:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334932736 00000100:00100000:0.0:1780809576.371439:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7411 00000100:00100000:0.0:1780809576.371446:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:141929:x1867312334932736:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809576.371463:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809576.371478:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2e12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fb1 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371529:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371539:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371547:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371556:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371573:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371577:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371852:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2e27 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371859:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2e27 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371865:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2e27 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809576.371874:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809576.371950:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371956:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371960:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371964:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809576.371966:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371971:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371988:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809576.371990:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809576.371994:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.371997:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2e19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372009:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372013:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372016:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372019:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809576.372021:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372024:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372041:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809576.372043:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809576.372046:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372052:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2e20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372101:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb1 expref: 21 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372114:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2e27 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb1 expref: 20 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.372119:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809576.372121:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809576.372122:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfa00, rc 0) 00000100:00100000:0.0:1780809576.372163:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:141929:x1867312334932736:12345-192.168.203.33@tcp:101:dd.0 Request processed in 717us (835us total) trans 55834578485 rc 0/0 00000100:00100000:0.0:1780809576.372168:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7411 00000100:00100000:3.0:1780809576.373215:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.373258:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334932864 00000100:00100000:2.0:1780809576.373263:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334932864 00000100:00100000:2.0:1780809576.373295:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2098 00000100:00100000:2.0:1780809576.373305:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2394:x1867312334932864:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809576.373315:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809576.373329:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f2e27 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb1 expref: 20 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.373344:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.373356:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809576.373392:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2394:x1867312334932864:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809576.373400:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2098 00000100:00100000:1.0:1780809576.408022:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809576.408095:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334932992 00000100:00100000:3.0:1780809576.408105:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334932992 00000100:00100000:3.0:1780809576.408171:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7412 00000100:00100000:3.0:1780809576.408183:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:141936:x1867312334932992:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809576.408206:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809576.408225:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2e35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fb8 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408286:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408300:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408311:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408326:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408333:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408340:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408567:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408576:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 20 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408581:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408630:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 20 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.408639:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 20 pid: 77628 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809576.408648:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338737280:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809576.408709:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadda873540 going to sleep for 11 seconds 00000100:00100000:3.0:1780809576.409551:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338737280:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809576.409568:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809576.409696:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809576.409738:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334933248 00000100:00100000:0.0:1780809576.409744:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334933248 00000100:00100000:0.0:1780809576.409816:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1729 00000100:00100000:0.0:1780809576.409825:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:90168:x1867312334933248:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809576.409977:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:90168:x1867312334933248:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 153us (281us total) trans 55834578486 rc 0/0 00000100:00100000:0.0:1780809576.409985:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1729 00000100:00100000:1.0:1780809576.410648:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809576.410692:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334933376 00000100:00100000:0.0:1780809576.410696:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334933376 00010000:00010000:0.0:1780809576.410709:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 22 pid: 77628 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809576.410728:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 511 00000100:00100000:0.0:1780809576.410733:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:2393:x1867312334933376:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809576.410746:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809576.410751:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 22 pid: 77628 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.410760:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 22 pid: 77628 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.410772:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f2de1 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fa3 expref: 22 pid: 77628 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.410792:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809576.410795:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.410800:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.410804:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.410817:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809576.410834:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809576.410839:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:2393:x1867312334933376:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 104us (191us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809576.410847:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809576.410850:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 511 00000004:00200000:3.0:1780809576.410875:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809576.410878:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809576.410888:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410897:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410903:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410916:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410921:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410924:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809576.410927:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410932:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410938:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809576.410940:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809576.410943:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410946:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410953:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410957:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410971:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410974:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809576.410979:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410983:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410989:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:3.0:1780809576.410990:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809576.410992:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.410995:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f2e43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.411019:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 21 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.411039:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 20 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.411044:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809576.411046:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809576.411047:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809576.411075:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:141936:x1867312334932992:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2896us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809576.411080:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7412 00000100:00100000:1.0:1780809576.412577:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809576.412634:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334933632 00000100:00100000:3.0:1780809576.412640:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334933632 00000100:00100000:3.0:1780809576.412670:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7413 00000100:00100000:3.0:1780809576.412676:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:141936:x1867312334933632:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809576.412693:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809576.412702:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fbf expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.412749:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.412761:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 21 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.412769:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.412790:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 21 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.412799:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 21 pid: 80225 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809576.412807:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338737408:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809576.412842:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadda873540 going to sleep for 11 seconds 00000100:00100000:3.0:1780809576.413413:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338737408:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809576.413424:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809576.413670:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.413712:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334933760 00000100:00100000:2.0:1780809576.413720:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334933760 00010000:00010000:2.0:1780809576.413735:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 22 pid: 80225 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.413755:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 512 00000100:00100000:2.0:1780809576.413761:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:2394:x1867312334933760:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809576.413767:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809576.413771:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 22 pid: 80225 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.413778:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 22 pid: 80225 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.413787:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2e4a lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fb8 expref: 22 pid: 80225 timeout: 1938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.413796:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.413799:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.413804:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.413808:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.413821:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809576.413832:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.413839:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.413844:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:2394:x1867312334933760:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000004:00200000:3.0:1780809576.413857:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809576.413869:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 512 00010000:00010000:3.0:1780809576.413929:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 22 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.413939:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 21 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809576.413944:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809576.413946:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809576.413947:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809576.413974:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:141936:x1867312334933632:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1297us (1398us total) trans 55834578487 rc 0/0 00000100:00100000:3.0:1780809576.413981:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7413 00000100:00100000:1.0:1780809576.499657:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.499709:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334934016 00000100:00100000:2.0:1780809576.499730:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334934016 00000100:00100000:2.0:1780809576.499773:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7414 00000100:00100000:2.0:1780809576.499780:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:141943:x1867312334934016:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809576.499800:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809576.499815:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fc6 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.499867:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.499877:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.499884:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.499892:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.499896:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.499900:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500193:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2e7b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500209:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2e7b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500216:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2e7b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809576.500225:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809576.500295:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500300:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500305:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500309:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809576.500311:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500316:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500324:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809576.500325:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809576.500328:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500332:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500368:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500374:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500380:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500386:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809576.500388:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500394:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500402:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54c00) 00010000:00010000:2.0:1780809576.500404:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809576.500406:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500410:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500447:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fc6 expref: 24 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500457:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2e7b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fc6 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.500468:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.500470:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809576.500472:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e400, rc 0) 00000100:00100000:2.0:1780809576.500513:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:141943:x1867312334934016:12345-192.168.203.33@tcp:101:dd.0 Request processed in 734us (866us total) trans 55834578488 rc 0/0 00000100:00100000:2.0:1780809576.500518:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7414 00000100:00100000:0.0:1780809576.501583:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.501628:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334934144 00000100:00100000:2.0:1780809576.501632:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334934144 00000100:00100000:0.0:1780809576.501658:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.501664:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2099 00000100:00100000:2.0:1780809576.501674:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2392:x1867312334934144:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809576.501684:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809576.501698:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2e7b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fc6 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809576.501708:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334934400 00010000:00010000:2.0:1780809576.501712:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00000100:00100000:1.0:1780809576.501714:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334934400 00010000:00010000:2.0:1780809576.501719:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809576.501748:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2392:x1867312334934144:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809576.501754:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1730 00000100:00100000:2.0:1780809576.501760:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2099 00000100:00100000:1.0:1780809576.501767:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:141943:x1867312334934400:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809576.501888:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:141943:x1867312334934400:12345-192.168.203.33@tcp:35:dd.0 Request processed in 125us (231us total) trans 55834578489 rc 0/0 00000100:00100000:1.0:1780809576.501895:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1730 00000100:00100000:0.0:1780809576.690348:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809576.690409:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334934656 00000100:00100000:1.0:1780809576.690419:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334934656 00000100:00100000:1.0:1780809576.690466:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1731 00000100:00100000:1.0:1780809576.690487:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:141929:x1867312334934656:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809576.690692:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141929:x1867312334934656:12345-192.168.203.33@tcp:35:dd.0 Request processed in 206us (350us total) trans 55834578490 rc 0/0 00000100:00100000:1.0:1780809576.690699:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1731 00000100:00100000:0.0:1780809576.846467:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.846654:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334934912 00000100:00100000:2.0:1780809576.846671:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334934912 00000100:00100000:2.0:1780809576.846725:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7415 00000100:00100000:2.0:1780809576.846736:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141958:x1867312334934912:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809576.846759:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809576.846789:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2e89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fcd expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.846857:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.846871:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.846884:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.846902:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849214:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849224:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849538:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e9e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849549:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e9e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849556:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e9e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809576.849566:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809576.849667:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849684:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849692:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849698:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809576.849702:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849711:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849723:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809576.849726:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809576.849731:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849737:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849759:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849766:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849772:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849777:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809576.849785:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849792:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849800:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54c00) 00010000:00010000:2.0:1780809576.849803:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809576.849806:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849812:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2e97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849852:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2e89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fcd expref: 27 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849865:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e9e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fcd expref: 26 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.849873:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.849875:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809576.849878:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:2.0:1780809576.849932:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:141958:x1867312334934912:12345-192.168.203.33@tcp:101:dd.0 Request processed in 3198us (3473us total) trans 55834578491 rc 0/0 00000100:00100000:2.0:1780809576.849940:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7415 00000100:00100000:0.0:1780809576.851058:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.851100:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334935040 00000100:00100000:2.0:1780809576.851106:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334935040 00000100:00100000:2.0:1780809576.851141:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2100 00000100:00100000:2.0:1780809576.851149:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2393:x1867312334935040:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809576.851166:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809576.851178:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2e9e lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fcd expref: 26 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.851198:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.851201:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809576.851227:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:2393:x1867312334935040:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809576.851234:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2100 00000100:00100000:0.0:1780809576.943393:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.943452:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334935168 00000100:00100000:2.0:1780809576.943461:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334935168 00000100:00100000:2.0:1780809576.943502:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7416 00000100:00100000:2.0:1780809576.943508:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:141964:x1867312334935168:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809576.943525:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809576.943544:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fd4 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943611:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943621:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943628:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943637:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943654:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943658:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943872:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943880:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943885:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943916:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.943925:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 26 pid: 77629 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.943935:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338737536:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809576.944009:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959840 going to sleep for 11 seconds 00000100:00100000:2.0:1780809576.944790:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338737536:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809576.944804:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809576.944907:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809576.944956:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334935424 00000100:00100000:1.0:1780809576.944962:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334935424 00000100:00100000:1.0:1780809576.944997:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1732 00000100:00100000:1.0:1780809576.945010:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:89646:x1867312334935424:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809576.945179:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:89646:x1867312334935424:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 174us (272us total) trans 55834578492 rc 0/0 00000100:00100000:1.0:1780809576.945187:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1732 00000100:00100000:0.0:1780809576.945840:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.945880:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334935552 00000100:00100000:2.0:1780809576.945890:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334935552 00010000:00010000:2.0:1780809576.945912:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 28 pid: 77629 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.945932:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 513 00000100:00100000:2.0:1780809576.945938:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01282850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2394:x1867312334935552:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809576.945947:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809576.945953:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 28 pid: 77629 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.945974:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 28 pid: 77629 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.945991:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2e58 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fbf expref: 28 pid: 77629 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.946008:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.946013:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.946021:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.946037:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.946061:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809576.946095:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.946097:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01282850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2394:x1867312334935552:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 158us (257us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809576.946111:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.946124:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 513 00000004:00200000:0.0:1780809576.946144:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809576.946149:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809576.946164:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946174:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946183:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946189:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946196:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946201:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809576.946206:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946213:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946234:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809576.946237:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809576.946241:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946247:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f2eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946270:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946275:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946280:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946324:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809576.946327:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946334:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946341:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54c00) 00010000:00010000:0.0:1780809576.946344:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809576.946346:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946352:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f2eba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946391:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f2eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 27 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946412:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 26 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.946418:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809576.946420:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809576.946423:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:0.0:1780809576.946454:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:141964:x1867312334935168:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2945us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809576.946460:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7416 00000100:00100000:0.0:1780809576.948395:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809576.948442:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334935808 00000100:00100000:1.0:1780809576.948448:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334935808 00000100:00100000:1.0:1780809576.948477:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7417 00000100:00100000:1.0:1780809576.948486:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:141964:x1867312334935808:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809576.948500:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809576.948513:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fdb expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809576.948576:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809576.948585:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 27 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809576.948606:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809576.948633:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 27 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809576.948642:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 27 pid: 79214 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809576.948651:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf5f60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338737664:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809576.948694:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded2989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809576.949447:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf5f60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338737664:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809576.949461:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809576.949668:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809576.949703:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334935936 00000100:00100000:2.0:1780809576.949709:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334935936 00010000:00010000:2.0:1780809576.949729:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 28 pid: 79214 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.949754:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 514 00000100:00100000:2.0:1780809576.949762:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2393:x1867312334935936:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809576.949771:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809576.949777:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 28 pid: 79214 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.949789:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 28 pid: 79214 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.949803:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2ec1 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fd4 expref: 28 pid: 79214 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.949822:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809576.949826:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.949834:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.949840:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809576.949870:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809576.949890:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.949900:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809576.949905:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2393:x1867312334935936:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809576.949915:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 514 00000004:00200000:0.0:1780809576.949918:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809576.950075:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f2ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 28 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.950104:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 27 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809576.950112:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809576.950115:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809576.950117:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:0.0:1780809576.950145:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:141964:x1867312334935808:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1661us (1753us total) trans 55834578493 rc 0/0 00000100:00100000:0.0:1780809576.950152:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7417 00010000:00010000:0.0:1780809577.011720:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809577.023125:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809577.023181:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334936192 00000100:00100000:3.0:1780809577.023189:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334936192 00000100:00100000:3.0:1780809577.023232:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7418 00000100:00100000:3.0:1780809577.023240:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:141971:x1867312334936192:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809577.023264:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809577.023283:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fe2 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023349:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023360:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023381:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023391:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023395:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023400:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023743:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2ef2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023753:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2ef2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023763:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2ef2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809577.023773:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809577.023855:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023873:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023881:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023888:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809577.023897:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023906:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023918:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809577.023922:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809577.023926:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023933:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023945:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023958:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023967:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023973:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809577.023976:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023982:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.023990:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:3.0:1780809577.023992:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809577.024001:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.024007:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f2eeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.024055:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f2edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fe2 expref: 30 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.024069:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2ef2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fe2 expref: 29 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.024076:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809577.024079:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809577.024081:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809577.024135:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:141971:x1867312334936192:12345-192.168.203.33@tcp:101:dd.0 Request processed in 896us (1016us total) trans 55834578494 rc 0/0 00000100:00100000:3.0:1780809577.024142:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7418 00000100:00100000:1.0:1780809577.025254:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.025293:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334936320 00000100:00100000:2.0:1780809577.025298:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334936320 00000100:00100000:1.0:1780809577.025307:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.025335:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2101 00000100:00100000:2.0:1780809577.025345:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2394:x1867312334936320:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1780809577.025348:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334936576 00010000:00010000:2.0:1780809577.025357:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809577.025373:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f2ef2 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fe2 expref: 29 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.025384:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.025386:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809577.025394:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334936576 00000100:00100000:2.0:1780809577.025416:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2394:x1867312334936320:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809577.025424:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1733 00000100:00100000:2.0:1780809577.025427:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2101 00000100:00100000:0.0:1780809577.025434:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:141971:x1867312334936576:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809577.025582:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:141971:x1867312334936576:12345-192.168.203.33@tcp:35:dd.0 Request processed in 150us (276us total) trans 55834578495 rc 0/0 00000100:00100000:0.0:1780809577.025608:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1733 00000100:00100000:1.0:1780809577.180480:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.180535:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334936832 00000100:00100000:2.0:1780809577.180544:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334936832 00000100:00100000:2.0:1780809577.180584:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1734 00000100:00100000:2.0:1780809577.180611:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:141958:x1867312334936832:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809577.180792:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:141958:x1867312334936832:12345-192.168.203.33@tcp:35:dd.0 Request processed in 181us (318us total) trans 55834578496 rc 0/0 00000100:00100000:2.0:1780809577.180797:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1734 00000100:00100000:3.0:1780809577.487735:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809577.487797:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334937088 00000100:00100000:0.0:1780809577.487807:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334937088 00000100:00100000:0.0:1780809577.487863:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7419 00000100:00100000:0.0:1780809577.487874:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:141979:x1867312334937088:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809577.487895:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809577.487914:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871fe9 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488000:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488033:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488045:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488060:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488068:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488074:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488368:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2f15 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488376:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2f15 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488381:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2f15 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809577.488387:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809577.488447:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488459:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488463:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488467:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809577.488470:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488475:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488483:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809577.488485:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809577.488488:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488492:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f2f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488506:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488512:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488518:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488522:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809577.488530:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488537:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488545:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809577.488547:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809577.488551:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488556:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f2f0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488634:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f2f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fe9 expref: 33 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488649:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2f15 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fe9 expref: 32 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.488656:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809577.488659:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809577.488662:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce200, rc 0) 00000100:00100000:0.0:1780809577.488723:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:141979:x1867312334937088:12345-192.168.203.33@tcp:101:dd.0 Request processed in 852us (995us total) trans 55834578497 rc 0/0 00000100:00100000:0.0:1780809577.488731:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7419 00000100:00100000:1.0:1780809577.489885:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.489939:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334937216 00000100:00100000:2.0:1780809577.489949:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334937216 00000100:00100000:2.0:1780809577.489980:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2102 00000100:00100000:2.0:1780809577.489986:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:2393:x1867312334937216:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809577.489995:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809577.490006:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f2f15 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fe9 expref: 32 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.490029:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.490033:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809577.490058:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2393:x1867312334937216:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809577.490063:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2102 00000100:00100000:1.0:1780809577.507087:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.507143:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334937472 00000100:00100000:2.0:1780809577.507153:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334937472 00000100:00100000:2.0:1780809577.507209:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7420 00000100:00100000:2.0:1780809577.507218:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:141985:x1867312334937472:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809577.507238:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809577.507255:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ff0 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507334:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507347:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507357:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507381:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507389:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507395:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507745:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f38 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507755:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f38 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507762:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f38 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809577.507771:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809577.507847:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507855:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507861:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507867:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809577.507871:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507887:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507898:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809577.507901:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809577.507906:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507912:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507934:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507940:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507946:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507950:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809577.507953:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507957:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507963:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54800) 00010000:00010000:2.0:1780809577.507965:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809577.507968:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.507981:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.508048:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff0 expref: 34 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.508064:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f38 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff0 expref: 33 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.508071:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.508074:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809577.508076:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:2.0:1780809577.508127:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:141985:x1867312334937472:12345-192.168.203.33@tcp:101:dd.0 Request processed in 911us (1045us total) trans 55834578498 rc 0/0 00000100:00100000:2.0:1780809577.508134:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7420 00000100:00100000:3.0:1780809577.509165:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809577.509249:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334937856 00000100:00100000:0.0:1780809577.509255:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334937856 00000100:00100000:0.0:1780809577.509281:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1735 00000100:00100000:0.0:1780809577.509288:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:141985:x1867312334937856:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809577.509325:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.509367:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334937728 00000100:00100000:2.0:1780809577.509372:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334937728 00000100:00100000:2.0:1780809577.509408:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2103 00000100:00100000:2.0:1780809577.509418:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2394:x1867312334937728:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809577.509429:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809577.509443:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f38 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff0 expref: 35 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809577.509444:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:141985:x1867312334937856:12345-192.168.203.33@tcp:35:dd.0 Request processed in 155us (279us total) trans 55834578499 rc 0/0 00000100:00100000:0.0:1780809577.509458:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1735 00010000:00010000:2.0:1780809577.509469:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.509474:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809577.509496:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2394:x1867312334937728:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809577.509512:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2103 00000100:00100000:3.0:1780809577.582436:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.582494:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334937984 00000100:00100000:2.0:1780809577.582504:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334937984 00000100:00100000:2.0:1780809577.582555:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7421 00000100:00100000:2.0:1780809577.582565:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:141992:x1867312334937984:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809577.582583:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809577.582620:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ff7 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.582671:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.582684:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.582694:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.582705:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.582712:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.582718:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.583010:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.583053:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 34 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.583061:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.583091:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 34 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.583104:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 34 pid: 78216 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.583116:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338737792:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809577.583183:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959780 going to sleep for 11 seconds 00000100:00100000:2.0:1780809577.583919:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338737792:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809577.583935:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809577.584049:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.584089:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334938240 00000100:00100000:2.0:1780809577.584093:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334938240 00000100:00100000:2.0:1780809577.584122:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1736 00000100:00100000:2.0:1780809577.584129:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:89646:x1867312334938240:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809577.584268:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:89646:x1867312334938240:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 139us (218us total) trans 55834578500 rc 0/0 00000100:00100000:2.0:1780809577.584277:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1736 00000100:00100000:1.0:1780809577.584889:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.584931:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334938368 00000100:00100000:2.0:1780809577.584941:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334938368 00010000:00010000:2.0:1780809577.584956:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 36 pid: 78216 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.584980:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 515 00000100:00100000:2.0:1780809577.584987:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2393:x1867312334938368:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809577.584995:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809577.585002:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 36 pid: 78216 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.585013:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 36 pid: 78216 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.585039:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f2ecf lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871fdb expref: 36 pid: 78216 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.585051:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.585055:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.585062:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.585068:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.585086:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809577.585110:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.585111:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2393:x1867312334938368:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 124us (221us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809577.585126:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.585140:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 515 00000004:00200000:1.0:1780809577.585160:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809577.585166:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809577.585182:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585192:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585209:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585213:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585218:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585221:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809577.585224:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585229:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585236:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809577.585238:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809577.585240:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585244:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585275:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585281:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585287:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585297:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809577.585300:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585303:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585309:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54800) 00010000:00010000:1.0:1780809577.585310:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809577.585312:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585316:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2f54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585350:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 35 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585358:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 34 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.585363:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809577.585364:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809577.585366:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:1.0:1780809577.585390:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:141992:x1867312334937984:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2828us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809577.585394:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7421 00000100:00100000:1.0:1780809577.586849:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.586888:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334938624 00000100:00100000:2.0:1780809577.586893:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334938624 00000100:00100000:2.0:1780809577.586921:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7422 00000100:00100000:2.0:1780809577.586929:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:141992:x1867312334938624:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809577.586941:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809577.586950:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046871ffe expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.586997:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.587008:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 35 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.587015:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.587045:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 35 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.587056:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 35 pid: 77628 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.587066:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338737920:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809577.587103:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959780 going to sleep for 11 seconds 00000100:00100000:2.0:1780809577.587829:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338737920:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809577.587843:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:2.0:1780809577.587854:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809577.587873:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334938752 00000100:00100000:1.0:1780809577.587878:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334938752 00010000:00010000:1.0:1780809577.587894:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 36 pid: 77628 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809577.587915:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 516 00000100:00100000:1.0:1780809577.587921:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2394:x1867312334938752:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809577.587928:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809577.587932:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 36 pid: 77628 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.587940:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 36 pid: 77628 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.587950:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f5b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ff7 expref: 36 pid: 77628 timeout: 1939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.587963:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809577.587966:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.587972:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.587975:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809577.587988:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809577.588010:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809577.588016:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2394:x1867312334938752:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 93us (175us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809577.588032:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809577.588046:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 516 00000004:00200000:2.0:1780809577.588050:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809577.588137:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 36 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.588157:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 35 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.588164:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.588167:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809577.588170:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:2.0:1780809577.588199:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:141992:x1867312334938624:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1270us (1350us total) trans 55834578501 rc 0/0 00000100:00100000:2.0:1780809577.588206:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7422 00000100:00100000:0.0:1780809577.814361:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809577.814419:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334939008 00000100:00100000:1.0:1780809577.814426:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334939008 00000100:00100000:1.0:1780809577.814469:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1737 00000100:00100000:1.0:1780809577.814477:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:141979:x1867312334939008:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809577.814539:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.814613:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334939136 00000100:00100000:2.0:1780809577.814624:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334939136 00000100:00100000:2.0:1780809577.814651:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7423 00000100:00100000:2.0:1780809577.814658:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:142006:x1867312334939136:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809577.814666:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809577.814681:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872005 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809577.814682:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:141979:x1867312334939008:12345-192.168.203.33@tcp:35:dd.0 Request processed in 205us (327us total) trans 55834578502 rc 0/0 00000100:00100000:1.0:1780809577.814687:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1737 00010000:00010000:2.0:1780809577.814733:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.814744:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.814757:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.814772:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.814780:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.814786:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.815037:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.815049:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 37 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.815057:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.815083:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 37 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.815100:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 37 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.815110:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338738048:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809577.815152:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959780 going to sleep for 11 seconds 00000100:00100000:2.0:1780809577.815742:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338738048:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809577.815754:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809577.815884:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.815916:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334939392 00000100:00100000:2.0:1780809577.815921:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334939392 00000100:00100000:2.0:1780809577.815948:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1738 00000100:00100000:2.0:1780809577.815954:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:90168:x1867312334939392:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809577.816051:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:90168:x1867312334939392:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 96us (167us total) trans 55834578503 rc 0/0 00000100:00100000:2.0:1780809577.816058:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1738 00000100:00100000:0.0:1780809577.816584:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.816636:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334939520 00000100:00100000:2.0:1780809577.816640:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334939520 00010000:00010000:2.0:1780809577.816654:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 39 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.816672:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 517 00000100:00100000:2.0:1780809577.816676:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2393:x1867312334939520:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809577.816683:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809577.816693:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 39 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.816709:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 39 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.816721:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2f69 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046871ffe expref: 39 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.816742:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.816745:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.816750:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.816754:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.816766:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809577.816788:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2393:x1867312334939520:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 110us (205us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809577.816789:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.816796:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 517 00010000:00010000:0.0:1780809577.816802:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809577.816822:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809577.816826:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809577.816836:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816845:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816851:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816856:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816860:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816864:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809577.816872:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816877:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816883:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809577.816885:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809577.816918:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816925:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f2f7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816940:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816946:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816952:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816957:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809577.816960:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816966:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816973:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54000) 00010000:00010000:0.0:1780809577.816976:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809577.816985:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.816991:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f2f85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.817033:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f2f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 38 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.817057:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 37 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809577.817064:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809577.817067:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809577.817069:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:0.0:1780809577.817100:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:142006:x1867312334939136:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2443us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809577.817109:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7423 00000100:00100000:0.0:1780809577.818314:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809577.818356:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334939776 00000100:00100000:3.0:1780809577.818361:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334939776 00000100:00100000:3.0:1780809577.818393:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7424 00000100:00100000:3.0:1780809577.818400:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:142006:x1867312334939776:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809577.818411:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809577.818426:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687200c expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.818477:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.818489:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 38 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.818497:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.818517:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 38 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.818527:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 38 pid: 78216 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809577.818538:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338738176:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809577.818578:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadda873540 going to sleep for 11 seconds 00000100:00100000:3.0:1780809577.819174:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338738176:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809577.819188:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809577.819319:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.819347:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334939904 00000100:00100000:2.0:1780809577.819351:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334939904 00010000:00010000:2.0:1780809577.819364:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 39 pid: 78216 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.819382:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 518 00000100:00100000:2.0:1780809577.819387:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2394:x1867312334939904:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809577.819397:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809577.819401:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 39 pid: 78216 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.819410:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 39 pid: 78216 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.819419:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2f8c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872005 expref: 39 pid: 78216 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.819429:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.819432:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.819437:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.819441:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.819453:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809577.819472:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2394:x1867312334939904:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 85us (153us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809577.819477:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809577.819477:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 518 00010000:00010000:3.0:1780809577.819488:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809577.819508:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809577.819567:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 39 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.819576:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 38 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.819581:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809577.819583:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809577.819585:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809577.819632:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142006:x1867312334939776:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1232us (1319us total) trans 55834578504 rc 0/0 00000100:00100000:3.0:1780809577.819639:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7424 00000100:00100000:0.0:1780809577.854096:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809577.854166:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334940160 00000100:00100000:3.0:1780809577.854177:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334940160 00000100:00100000:3.0:1780809577.854224:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7425 00000100:00100000:3.0:1780809577.854230:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142014:x1867312334940160:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809577.854250:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809577.854266:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2fa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872013 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854328:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854339:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854359:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854368:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854373:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854377:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854645:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2fbd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854652:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2fbd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854656:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2fbd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809577.854663:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809577.854724:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854729:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854733:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854741:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809577.854749:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854754:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854762:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809577.854764:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809577.854767:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854771:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f2faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854780:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854784:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854787:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854790:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809577.854792:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854795:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854798:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:3.0:1780809577.854800:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809577.854805:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854809:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f2fb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854836:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f2fa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872013 expref: 41 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854844:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2fbd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872013 expref: 40 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809577.854849:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809577.854851:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809577.854853:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809577.854906:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:142014:x1867312334940160:12345-192.168.203.33@tcp:101:dd.0 Request processed in 674us (817us total) trans 55834578505 rc 0/0 00000100:00100000:3.0:1780809577.854914:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7425 00000100:00100000:1.0:1780809577.855825:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809577.855867:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334940288 00000100:00100000:2.0:1780809577.855872:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334940288 00000100:00100000:2.0:1780809577.855897:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2104 00000100:00100000:2.0:1780809577.855903:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2393:x1867312334940288:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809577.855916:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809577.855926:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f2fbd lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872013 expref: 40 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809577.855935:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809577.855937:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809577.855964:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2393:x1867312334940288:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 61us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809577.855972:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2104 00010000:00010000:1.0:1780809578.035741:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809578.044756:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.044816:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334940544 00000100:00100000:2.0:1780809578.044826:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334940544 00000100:00080000:0.0:1780809578.044873:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780809578.044881:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7426 00000100:00100000:2.0:1780809578.044889:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142020:x1867312334940544:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809578.044909:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809578.044924:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687201a expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.044978:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.044992:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045001:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045009:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045041:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045045:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045325:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2fe0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045332:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2fe0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045337:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2fe0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809578.045344:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809578.045405:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045410:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045414:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045418:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809578.045420:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045424:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045440:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809578.045442:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809578.045445:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045449:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f2fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045466:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045470:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045473:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045476:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809578.045478:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045481:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045484:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809578.045486:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809578.045487:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045490:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f2fd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045541:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f2fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687201a expref: 42 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045556:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2fe0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687201a expref: 41 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.045564:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809578.045566:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809578.045569:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:2.0:1780809578.045658:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142020:x1867312334940544:12345-192.168.203.33@tcp:101:dd.0 Request processed in 768us (910us total) trans 55834578506 rc 0/0 00000100:00100000:2.0:1780809578.045667:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7426 00000100:00100000:0.0:1780809578.046734:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809578.046772:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.046774:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334940672 00000100:00100000:2.0:1780809578.046778:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334940672 00000100:00100000:2.0:1780809578.046810:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2105 00000100:00100000:2.0:1780809578.046817:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae00a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2394:x1867312334940672:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809578.046822:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334940928 00010000:00010000:2.0:1780809578.046826:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780809578.046829:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334940928 00010000:00010000:2.0:1780809578.046839:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f2fe0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687201a expref: 42 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.046854:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809578.046856:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809578.046867:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1739 00000100:00100000:1.0:1780809578.046878:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc7106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142020:x1867312334940928:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809578.046882:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae00a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2394:x1867312334940672:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809578.046888:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2105 00000100:00100000:1.0:1780809578.046999:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc7106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142020:x1867312334940928:12345-192.168.203.33@tcp:35:dd.0 Request processed in 123us (227us total) trans 55834578507 rc 0/0 00000100:00100000:1.0:1780809578.047006:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1739 00000100:00100000:0.0:1780809578.147713:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809578.147777:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334941056 00000100:00100000:1.0:1780809578.147786:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334941056 00000100:00100000:1.0:1780809578.147832:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7427 00000100:00100000:1.0:1780809578.147839:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142027:x1867312334941056:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809578.147858:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809578.147873:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f2fee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872021 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.147932:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.147944:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.147960:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.147979:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.147985:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.147993:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.148284:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.148293:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 42 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.148298:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.148321:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 42 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.148339:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 42 pid: 80225 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809578.148348:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc1f76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338738304:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809578.148405:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded298480 going to sleep for 11 seconds 00000100:00100000:2.0:1780809578.149268:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc1f76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338738304:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809578.149288:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809578.149326:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.149363:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334941312 00000100:00100000:2.0:1780809578.149368:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334941312 00000100:00100000:2.0:1780809578.149402:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1740 00000100:00100000:2.0:1780809578.149407:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:89646:x1867312334941312:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809578.149544:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:89646:x1867312334941312:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 135us (219us total) trans 55834578508 rc 0/0 00000100:00100000:2.0:1780809578.149552:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1740 00000100:00100000:1.0:1780809578.150208:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.150252:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334941440 00000100:00100000:2.0:1780809578.150257:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334941440 00010000:00010000:2.0:1780809578.150274:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 44 pid: 80225 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809578.150295:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 519 00000100:00100000:2.0:1780809578.150300:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2393:x1867312334941440:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809578.150307:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809578.150311:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 44 pid: 80225 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.150320:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 44 pid: 80225 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.150335:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f2f9a lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687200c expref: 44 pid: 80225 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.150356:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809578.150360:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.150365:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.150370:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.150384:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809578.150408:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2393:x1867312334941440:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 104us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809578.150413:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 519 00010000:00010000:1.0:1780809578.150414:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150424:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809578.150450:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809578.150455:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809578.150468:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150478:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150487:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150494:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150500:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150506:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809578.150515:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150523:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150531:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809578.150534:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809578.150538:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150545:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f2ff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150555:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150562:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150567:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150572:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809578.150574:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150580:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150586:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809578.150623:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809578.150632:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150639:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f2ffc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150672:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f2fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 43 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150685:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 42 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.150701:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809578.150704:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809578.150707:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65c00, rc 0) 00000100:00100000:1.0:1780809578.150736:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:142027:x1867312334941056:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2896us (3029us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809578.150743:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7427 00000100:00100000:1.0:1780809578.152082:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.152119:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334941696 00000100:00100000:2.0:1780809578.152125:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334941696 00000100:00100000:2.0:1780809578.152158:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7428 00000100:00100000:2.0:1780809578.152165:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:142027:x1867312334941696:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809578.152179:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809578.152194:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f300a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872028 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.152255:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.152268:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 43 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.152285:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.152304:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 43 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.152313:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 43 pid: 77628 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809578.152323:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338738432:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809578.152366:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959480 going to sleep for 11 seconds 00000100:00100000:2.0:1780809578.152945:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338738432:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809578.152960:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809578.153092:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.153127:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334941824 00000100:00100000:2.0:1780809578.153132:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334941824 00010000:00010000:2.0:1780809578.153151:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 44 pid: 77628 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809578.153177:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 520 00000100:00100000:2.0:1780809578.153186:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2393:x1867312334941824:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809578.153196:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809578.153202:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 44 pid: 77628 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.153226:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 44 pid: 77628 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.153240:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3003 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872021 expref: 44 pid: 77628 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.153252:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809578.153256:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.153264:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.153271:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.153293:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809578.153314:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809578.153327:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2393:x1867312334941824:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 141us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809578.153343:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 520 00010000:00010000:0.0:1780809578.153343:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809578.153359:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809578.153501:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f300a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 44 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.153529:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 43 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.153536:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809578.153539:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809578.153542:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:0.0:1780809578.153572:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142027:x1867312334941696:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1407us (1490us total) trans 55834578509 rc 0/0 00000100:00100000:0.0:1780809578.153579:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7428 00000100:00100000:1.0:1780809578.160085:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809578.160139:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334942080 00000100:00100000:0.0:1780809578.160149:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334942080 00000100:00100000:0.0:1780809578.160198:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1741 00000100:00100000:0.0:1780809578.160208:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142014:x1867312334942080:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809578.160414:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142014:x1867312334942080:12345-192.168.203.33@tcp:35:dd.0 Request processed in 206us (332us total) trans 55834578510 rc 0/0 00000100:00100000:0.0:1780809578.160423:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1741 00000100:00100000:3.0:1780809578.193235:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809578.193281:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334942336 00000100:00100000:1.0:1780809578.193289:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334942336 00000100:00100000:1.0:1780809578.193328:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7429 00000100:00100000:1.0:1780809578.193335:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142035:x1867312334942336:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809578.193352:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809578.193367:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f301f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687202f expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193434:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193444:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193452:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193460:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193464:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193468:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193754:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3034 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193761:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3034 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193765:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3034 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809578.193772:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809578.193834:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193845:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193850:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193853:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809578.193856:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193861:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193869:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809578.193871:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809578.193874:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193877:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193884:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193888:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193891:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193894:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809578.193899:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193903:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193907:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809578.193908:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809578.193909:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193912:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f302d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193939:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f301f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687202f expref: 47 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193947:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3034 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687202f expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.193951:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809578.193952:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809578.193955:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64c00, rc 0) 00000100:00100000:1.0:1780809578.194003:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:142035:x1867312334942336:12345-192.168.203.33@tcp:101:dd.0 Request processed in 667us (773us total) trans 55834578511 rc 0/0 00000100:00100000:1.0:1780809578.194010:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7429 00000100:00100000:1.0:1780809578.195101:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.195147:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334942464 00000100:00100000:2.0:1780809578.195153:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334942464 00000100:00100000:2.0:1780809578.195192:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2106 00000100:00100000:2.0:1780809578.195201:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2393:x1867312334942464:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809578.195212:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809578.195225:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3034 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687202f expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.195249:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809578.195253:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809578.195285:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2393:x1867312334942464:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809578.195293:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2106 00000100:00100000:2.0:1780809578.355781:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338738560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780809578.355838:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809578.355884:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338738560 00000100:00100000:1.0:1780809578.355893:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338738560 00000100:00100000:1.0:1780809578.355944:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1780809578.355967:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338738560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780809578.356003:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1780809578.356068:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338738560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809578.356077:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1780809578.356098:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338738560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780809578.386524:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809578.386612:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334942720 00000100:00100000:3.0:1780809578.386623:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334942720 00000100:00100000:3.0:1780809578.386677:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7430 00000100:00100000:3.0:1780809578.386689:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:142041:x1867312334942720:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809578.386712:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809578.386732:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872036 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.386820:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.386847:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.386860:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.386875:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.386884:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.386891:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387264:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3057 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387274:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3057 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387282:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3057 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809578.387292:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809578.387374:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387382:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387388:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387401:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809578.387405:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387413:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387425:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809578.387428:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809578.387432:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387439:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387451:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387458:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387464:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387469:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809578.387472:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387479:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387497:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:3.0:1780809578.387500:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809578.387504:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387510:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3050 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387548:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872036 expref: 48 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387564:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3057 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872036 expref: 47 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.387572:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809578.387574:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809578.387577:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809578.387669:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142041:x1867312334942720:12345-192.168.203.33@tcp:101:dd.0 Request processed in 983us (1152us total) trans 55834578512 rc 0/0 00000100:00100000:3.0:1780809578.387677:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7430 00000100:00100000:3.0:1780809578.388748:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.388789:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334942848 00000100:00100000:2.0:1780809578.388795:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334942848 00000100:00100000:3.0:1780809578.388801:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.388842:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2107 00000100:00100000:2.0:1780809578.388850:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01282450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2393:x1867312334942848:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809578.388851:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334943104 00000100:00100000:1.0:1780809578.388858:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334943104 00010000:00010000:2.0:1780809578.388862:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809578.388875:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3057 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872036 expref: 48 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.388885:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809578.388888:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809578.388897:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1742 00000100:00100000:1.0:1780809578.388909:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142041:x1867312334943104:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809578.388921:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01282450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2393:x1867312334942848:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809578.388926:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2107 00000100:00100000:1.0:1780809578.389039:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142041:x1867312334943104:12345-192.168.203.33@tcp:35:dd.0 Request processed in 134us (239us total) trans 55834578513 rc 0/0 00000100:00100000:1.0:1780809578.389046:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1742 00000100:00100000:3.0:1780809578.497507:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809578.497553:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334943360 00000100:00100000:0.0:1780809578.497561:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334943360 00000100:00100000:0.0:1780809578.497635:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1743 00000100:00100000:0.0:1780809578.497643:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142035:x1867312334943360:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809578.497830:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:142035:x1867312334943360:12345-192.168.203.33@tcp:35:dd.0 Request processed in 187us (330us total) trans 55834578514 rc 0/0 00000100:00100000:0.0:1780809578.497835:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1743 00000100:00100000:0.0:1780809578.580460:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809578.580513:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334943488 00000100:00100000:3.0:1780809578.580522:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334943488 00000100:00100000:3.0:1780809578.580576:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7431 00000100:00100000:3.0:1780809578.580616:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:142049:x1867312334943488:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809578.580649:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809578.580666:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3065 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687203d expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580725:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580738:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580749:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580758:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580762:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580766:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580986:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580994:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 49 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.580999:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.581034:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 49 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.581049:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 49 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809578.581058:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338738688:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809578.581118:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadded7ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1780809578.581984:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338738688:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809578.582004:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809578.582130:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809578.582176:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334943744 00000100:00100000:1.0:1780809578.582182:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334943744 00000100:00100000:1.0:1780809578.582226:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1744 00000100:00100000:1.0:1780809578.582235:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:90168:x1867312334943744:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809578.582398:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:90168:x1867312334943744:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 163us (267us total) trans 55834578515 rc 0/0 00000100:00100000:1.0:1780809578.582406:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1744 00000100:00100000:2.0:1780809578.583285:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809578.583330:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334943872 00000100:00100000:1.0:1780809578.583334:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334943872 00010000:00010000:1.0:1780809578.583358:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 51 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809578.583391:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 521 00000100:00100000:1.0:1780809578.583399:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2393:x1867312334943872:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809578.583416:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809578.583421:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 51 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.583431:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 51 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.583445:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3011 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872028 expref: 51 pid: 79214 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.583465:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809578.583468:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.583473:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.583478:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.583497:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809578.583528:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2393:x1867312334943872:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 129us (244us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809578.583529:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583536:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809578.583538:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 521 00000004:00200000:3.0:1780809578.583566:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809578.583571:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809578.583585:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583619:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583628:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583635:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583651:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583657:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809578.583661:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583669:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583679:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809578.583682:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809578.583686:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583692:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f306c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583704:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583710:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583716:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583721:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809578.583725:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583743:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583752:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:3.0:1780809578.583754:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809578.583757:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583764:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3073 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583792:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3065 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 50 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583806:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 49 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809578.583813:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809578.583815:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809578.583818:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809578.583853:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142049:x1867312334943488:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3267us (3399us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809578.583861:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7431 00000100:00100000:2.0:1780809578.585463:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809578.585530:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334944128 00000100:00100000:0.0:1780809578.585537:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334944128 00000100:00100000:0.0:1780809578.585579:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7432 00000100:00100000:0.0:1780809578.585613:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142049:x1867312334944128:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809578.585633:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809578.585649:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f3081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872044 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.585739:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.585753:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 50 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.585761:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.585789:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 50 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.585802:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 50 pid: 77629 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809578.585822:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee578380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338738816:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809578.585886:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc57d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780809578.587298:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee578380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338738816:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809578.587319:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809578.587544:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809578.587655:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334944256 00000100:00100000:0.0:1780809578.587661:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334944256 00010000:00010000:0.0:1780809578.587688:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 51 pid: 77629 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809578.587723:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 522 00000100:00100000:0.0:1780809578.587732:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2394:x1867312334944256:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809578.587743:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809578.587750:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 51 pid: 77629 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.587762:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 51 pid: 77629 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.587780:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f307a lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687203d expref: 51 pid: 77629 timeout: 1940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.587794:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809578.587799:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.587807:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.587824:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.587846:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809578.587870:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.587882:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809578.587890:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2394:x1867312334944256:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 158us (345us total) trans 0 rc 0/0 00000004:00200000:1.0:1780809578.587895:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:0.0:1780809578.587900:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 522 00010000:00010000:1.0:1780809578.588025:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f3081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.588046:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.588053:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809578.588059:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809578.588062:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce000, rc 0) 00000100:00100000:1.0:1780809578.588092:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142049:x1867312334944128:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2506us (2634us total) trans 55834578516 rc 0/0 00000100:00100000:1.0:1780809578.588099:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7432 00000100:00100000:2.0:1780809578.722926:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809578.722973:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334944512 00000100:00100000:1.0:1780809578.722982:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334944512 00000100:00100000:1.0:1780809578.723036:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7433 00000100:00100000:1.0:1780809578.723044:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142063:x1867312334944512:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809578.723062:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809578.723077:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687204b expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723130:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723151:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723160:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723170:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723174:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723178:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723446:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f30ab lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723453:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f30ab lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723457:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f30ab lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809578.723470:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809578.723535:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723539:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723544:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723552:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809578.723555:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723560:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723567:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809578.723569:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809578.723573:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723577:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f309d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723585:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723620:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723623:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723626:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809578.723628:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723632:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723646:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:1.0:1780809578.723648:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809578.723650:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723654:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723683:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687204b expref: 53 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723691:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f30ab lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687204b expref: 52 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.723696:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809578.723697:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809578.723699:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64e00, rc 0) 00000100:00100000:1.0:1780809578.723738:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142063:x1867312334944512:12345-192.168.203.33@tcp:101:dd.0 Request processed in 695us (819us total) trans 55834578517 rc 0/0 00000100:00100000:1.0:1780809578.723742:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7433 00000100:00100000:0.0:1780809578.724798:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809578.724870:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334944640 00000100:00100000:2.0:1780809578.724875:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334944640 00000100:00100000:2.0:1780809578.724908:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2108 00000100:00100000:2.0:1780809578.724916:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee57b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2393:x1867312334944640:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809578.724926:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809578.724939:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f30ab lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687204b expref: 52 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809578.724959:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809578.724962:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809578.724987:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee57b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2393:x1867312334944640:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809578.724991:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2108 00000100:00100000:2.0:1780809578.840241:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809578.840297:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334944896 00000100:00100000:0.0:1780809578.840307:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334944896 00000100:00100000:0.0:1780809578.840369:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7434 00000100:00100000:0.0:1780809578.840381:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:142069:x1867312334944896:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809578.840406:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809578.840427:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f30b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872052 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840495:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840509:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840522:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840536:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840544:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840564:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840962:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f30ce lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840972:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f30ce lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.840981:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f30ce lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809578.840991:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809578.841087:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841095:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841102:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841108:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809578.841112:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841120:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841131:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809578.841133:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809578.841144:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841150:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f30c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841167:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841173:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841179:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841184:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809578.841188:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841193:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841201:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809578.841203:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809578.841206:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841212:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f30c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841250:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f30b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872052 expref: 54 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841274:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f30ce lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872052 expref: 53 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809578.841281:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809578.841284:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809578.841286:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf000, rc 0) 00000100:00100000:0.0:1780809578.841339:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:142069:x1867312334944896:12345-192.168.203.33@tcp:101:dd.0 Request processed in 961us (1106us total) trans 55834578518 rc 0/0 00000100:00100000:0.0:1780809578.841346:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7434 00000100:00100000:0.0:1780809578.842397:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809578.842431:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809578.842443:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334945024 00000100:00100000:1.0:1780809578.842450:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334945024 00000100:00100000:2.0:1780809578.842475:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334945280 00000100:00100000:2.0:1780809578.842479:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334945280 00000100:00100000:1.0:1780809578.842491:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2109 00000100:00100000:1.0:1780809578.842499:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee578380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2391:x1867312334945024:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1780809578.842507:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1745 00010000:00010000:1.0:1780809578.842509:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1780809578.842514:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:142069:x1867312334945280:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809578.842523:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f30ce lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872052 expref: 54 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809578.842547:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809578.842551:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809578.842582:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee578380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2391:x1867312334945024:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809578.842610:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2109 00000100:00100000:2.0:1780809578.842647:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:142069:x1867312334945280:12345-192.168.203.33@tcp:35:dd.0 Request processed in 132us (214us total) trans 55834578519 rc 0/0 00000100:00100000:2.0:1780809578.842652:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1745 00000100:00100000:3.0:1780809579.022672:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.022734:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334945536 00000100:00100000:1.0:1780809579.022746:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334945536 00000100:00100000:1.0:1780809579.022801:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1746 00000100:00100000:1.0:1780809579.022811:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:142063:x1867312334945536:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809579.022994:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:142063:x1867312334945536:12345-192.168.203.33@tcp:35:dd.0 Request processed in 184us (328us total) trans 55834578520 rc 0/0 00000100:00100000:1.0:1780809579.022999:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1746 00010000:00010000:0.0:1780809579.059725:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809579.091971:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.092045:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334945792 00000100:00100000:1.0:1780809579.092053:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334945792 00000100:00100000:1.0:1780809579.092098:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7435 00000100:00100000:1.0:1780809579.092104:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:142078:x1867312334945792:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809579.092134:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809579.092152:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f30dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872059 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092213:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092226:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092254:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092269:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092276:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092280:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092528:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f30f1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092535:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f30f1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092539:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f30f1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809579.092546:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809579.092639:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092645:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092649:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092652:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.092661:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092665:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092674:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809579.092677:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.092680:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092684:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f30e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092691:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092694:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092698:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092701:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.092702:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092706:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092709:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:1.0:1780809579.092710:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.092715:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092718:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f30ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092747:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f30dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872059 expref: 57 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092755:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f30f1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872059 expref: 56 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.092760:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809579.092761:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809579.092763:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64a00, rc 0) 00000100:00100000:1.0:1780809579.092807:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142078:x1867312334945792:12345-192.168.203.33@tcp:101:dd.0 Request processed in 703us (845us total) trans 55834578521 rc 0/0 00000100:00100000:1.0:1780809579.092812:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7435 00000100:00100000:0.0:1780809579.093855:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.093904:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334945920 00000100:00100000:2.0:1780809579.093909:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334945920 00000100:00100000:2.0:1780809579.093938:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2110 00000100:00100000:2.0:1780809579.093943:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2394:x1867312334945920:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809579.093958:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809579.093971:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f30f1 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872059 expref: 56 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.093981:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809579.093983:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809579.094006:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2394:x1867312334945920:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.094021:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2110 00000100:00100000:0.0:1780809579.317412:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809579.317460:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334946048 00000100:00100000:3.0:1780809579.317468:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334946048 00000100:00100000:3.0:1780809579.317513:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7436 00000100:00100000:3.0:1780809579.317533:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142084:x1867312334946048:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809579.317552:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809579.317566:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f30ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872060 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317629:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317639:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317647:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317656:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317660:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317664:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317915:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317923:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 56 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317928:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317959:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 56 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809579.317969:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 56 pid: 77627 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809579.317979:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338738944:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809579.318046:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadded7ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1780809579.318776:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338738944:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809579.318795:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809579.318912:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.318955:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334946304 00000100:00100000:2.0:1780809579.318960:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334946304 00000100:00100000:2.0:1780809579.318993:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1747 00000100:00100000:2.0:1780809579.319000:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:89645:x1867312334946304:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809579.319138:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:89645:x1867312334946304:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 137us (224us total) trans 55834578522 rc 0/0 00000100:00100000:2.0:1780809579.319147:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1747 00000100:00100000:3.0:1780809579.319828:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.319870:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334946432 00000100:00100000:2.0:1780809579.319875:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334946432 00010000:00010000:2.0:1780809579.319892:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 58 pid: 77627 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809579.319920:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 523 00000100:00100000:2.0:1780809579.319928:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2393:x1867312334946432:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809579.319937:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809579.319943:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 58 pid: 77627 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.319966:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 58 pid: 77627 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.319980:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3088 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872044 expref: 58 pid: 77627 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.319998:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809579.320002:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.320024:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.320031:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.320048:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809579.320078:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312334946432:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 150us (249us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809579.320079:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809579.320089:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 523 00010000:00010000:0.0:1780809579.320093:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809579.320121:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809579.320126:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809579.320149:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320160:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320169:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320176:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320182:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320188:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809579.320192:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320200:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320209:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809579.320212:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809579.320216:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320222:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320231:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320237:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320286:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320292:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809579.320295:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320302:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320310:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91d00) 00010000:00010000:0.0:1780809579.320312:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809579.320316:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320322:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f310d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320348:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f30ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 57 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320361:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 56 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.320369:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809579.320371:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809579.320374:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:0.0:1780809579.320404:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142084:x1867312334946048:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2873us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809579.320420:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7436 00000100:00100000:3.0:1780809579.321931:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809579.321969:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334946688 00000100:00100000:0.0:1780809579.321975:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334946688 00000100:00100000:0.0:1780809579.322023:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7437 00000100:00100000:0.0:1780809579.322036:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142084:x1867312334946688:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809579.322050:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809579.322061:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f311b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872067 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.322119:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.322131:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 57 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.322139:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.322162:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 57 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.322175:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 57 pid: 80225 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809579.322186:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338739072:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809579.322231:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc57d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780809579.322811:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338739072:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809579.322831:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809579.323021:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.323074:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334946816 00000100:00100000:1.0:1780809579.323078:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334946816 00010000:00010000:1.0:1780809579.323097:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 58 pid: 80225 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809579.323125:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 524 00000100:00100000:1.0:1780809579.323137:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01283850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2394:x1867312334946816:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809579.323146:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809579.323152:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 58 pid: 80225 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.323168:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 58 pid: 80225 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.323177:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3114 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872060 expref: 58 pid: 80225 timeout: 1941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.323186:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809579.323189:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.323194:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.323198:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.323210:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809579.323226:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809579.323233:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01283850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2394:x1867312334946816:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 97us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809579.323241:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809579.323242:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 524 00000004:00200000:0.0:1780809579.323255:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809579.323377:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f311b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 58 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.323393:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 57 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.323400:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809579.323403:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809579.323405:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf400, rc 0) 00000100:00100000:0.0:1780809579.323438:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142084:x1867312334946688:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1407us (1507us total) trans 55834578523 rc 0/0 00000100:00100000:0.0:1780809579.323444:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7437 00000100:00100000:3.0:1780809579.377361:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.377424:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334947072 00000100:00100000:1.0:1780809579.377433:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334947072 00000100:00100000:1.0:1780809579.377485:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1748 00000100:00100000:1.0:1780809579.377502:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142078:x1867312334947072:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809579.377736:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:142078:x1867312334947072:12345-192.168.203.33@tcp:35:dd.0 Request processed in 242us (380us total) trans 55834578524 rc 0/0 00000100:00100000:1.0:1780809579.377744:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1748 00000100:00100000:1.0:1780809579.379703:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338739328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809579.379705:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338739200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780809579.379717:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338739456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780809579.379752:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809579.379787:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338739200 00000100:00100000:0.0:1780809579.379787:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809579.379792:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338739200 00000100:00100000:2.0:1780809579.379822:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809579.379833:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338739456 00000100:00100000:1.0:1780809579.379836:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338739456 00000100:00080000:0.0:1780809579.379838:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780809579.379858:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338739328 00000100:00100000:0.0:1780809579.379863:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338739328 00000100:00100000:1.0:1780809579.379866:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1780809579.379873:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1780809579.379876:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338739200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809579.379884:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338739456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780809579.379898:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00002000:00000024:1.0:1780809579.379900:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3566206976 avail 3564109824 00002000:00000024:2.0:1780809579.379907:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3566206976 avail 3564109824 00000100:00100000:0.0:1780809579.379910:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338739328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780809579.379941:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:1.0:1780809579.379947:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338739200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.379965:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338739456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809579.379969:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1780809579.379984:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1780809579.379995:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338739328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809579.380003:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1780809579.380043:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338739456:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1780809579.380044:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780809579.380064:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338739840:0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.380073:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1867312338739968:0@lo:400:kworker.0 00000100:00100000:1.0:1780809579.380111:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338739584:0@lo:400:kworker.0 00000100:00100000:0.0:1780809579.380116:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809579.380130:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809579.380159:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809579.380170:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338740480:0@lo:400:kworker.0 00000100:00100000:0.0:1780809579.380173:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338739328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780809579.380198:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338740352:0@lo:400:kworker.0 00000100:00100000:1.0:1780809579.380203:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338740096:0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.380218:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338739712:0@lo:400:kworker.0 00000100:00100000:0.0:1780809579.380242:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809579.380247:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809579.380268:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338740096 00000100:00100000:2.0:1780809579.380272:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338740096 00000100:00100000:1.0:1780809579.380290:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338740608:0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.380305:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1780809579.380307:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338739840 00000100:00100000:0.0:1780809579.380313:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338739840 00000100:00100000:2.0:1780809579.380314:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338740096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809579.380322:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809579.380364:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1780809579.380371:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338739840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.380381:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809579.380381:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338739584 00000100:00100000:1.0:1780809579.380387:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338739584 00000100:00100000:0.0:1780809579.380423:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338739840:12345-0@lo:400:kworker.0 Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809579.380425:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1780809579.380436:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1780809579.380439:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338739584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.380458:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338740224:0@lo:400:kworker.0 00000100:00100000:3.0:1780809579.380460:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338740096:12345-0@lo:400:kworker.0 Request processed in 146us (213us total) trans 0 rc 0/0 00000100:00080000:0.0:1780809579.380464:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780809579.380472:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1780809579.380493:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338739712 00000100:00100000:3.0:1780809579.380498:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338739712 00000100:00100000:0.0:1780809579.380498:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338739840:0@lo:400:kworker.0 00000100:00100000:1.0:1780809579.380502:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338739584:12345-0@lo:400:kworker.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.380506:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809579.380518:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1780809579.380535:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338739968 00000100:00100000:3.0:1780809579.380536:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1780809579.380539:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338740736:0@lo:400:kworker.0 00000100:00100000:0.0:1780809579.380542:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338739968 00000100:00100000:3.0:1780809579.380549:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338739712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809579.380566:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338739584:0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.380573:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809579.380584:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338740352 00000100:00100000:1.0:1780809579.380613:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338740096:0@lo:400:kworker.0 00000100:00100000:0.0:1780809579.380614:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338740352 00000100:00100000:3.0:1780809579.380627:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338739712:12345-0@lo:400:kworker.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00080000:0.0:1780809579.380635:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809579.380638:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1780809579.380638:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338739200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780809579.380659:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338740608 00000100:00100000:1.0:1780809579.380664:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338740608 00000100:00100000:0.0:1780809579.380664:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338740224 00000100:00100000:2.0:1780809579.380665:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338739712:0@lo:400:kworker.0 00000100:00100000:0.0:1780809579.380671:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338740224 00000100:00100000:3.0:1780809579.380692:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780809579.380695:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809579.380701:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338740736 00000100:00100000:0.0:1780809579.380711:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338740736 00000100:00100000:1.0:1780809579.380730:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338740480 00000100:00100000:1.0:1780809579.380735:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338740480 00000100:00100000:3.0:1780809579.380738:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00080000:1.0:1780809579.380748:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780809579.380750:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1867312338739968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809579.380758:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1780809579.380770:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338740352:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1780809579.380772:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780809579.380794:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1780809579.380805:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae00a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338740224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809579.380813:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1867312338739968:12345-0@lo:400:kworker.0 Request processed in 65us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809579.380814:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1780809579.380828:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338740608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809579.380829:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1780809579.380830:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338740352:12345-0@lo:400:kworker.0 Request processed in 60us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809579.380844:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1780809579.380855:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1780809579.380864:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338740736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809579.380888:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338740608:12345-0@lo:400:kworker.0 Request processed in 64us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809579.380897:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1780809579.380906:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae00a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338740224:12345-0@lo:400:kworker.0 Request processed in 102us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809579.380916:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338740736:12345-0@lo:400:kworker.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.380918:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1780809579.380919:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338740352:0@lo:400:kworker.0 00000100:00100000:3.0:1780809579.380931:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1780809579.380935:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338740608:0@lo:400:kworker.0 00000100:00100000:3.0:1780809579.380956:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1780809579.380966:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338740480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.380970:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338740224:0@lo:400:kworker.0 00010000:00080000:2.0:1780809579.380993:0:3444:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacda8c8e00 x1867312338740736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809579.381002:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338740736:0@lo:400:kworker.0 00000100:00100000:3.0:1780809579.381041:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338740480:12345-0@lo:400:kworker.0 Request processed in 77us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809579.381048:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00010000:00080000:2.0:1780809579.381068:0:3442:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacda8c9c00 x1867312338740480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809579.381077:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338740480:0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.381086:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1867312338739968:0@lo:400:kworker.0 00000100:00100000:2.0:1780809579.446550:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.446609:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334947328 00000100:00100000:1.0:1780809579.446617:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334947328 00000100:00100000:1.0:1780809579.446661:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7438 00000100:00100000:1.0:1780809579.446669:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:142092:x1867312334947328:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809579.446688:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809579.446702:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687206e expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.446754:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.446765:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.446772:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.446791:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.446796:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.446799:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447076:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3145 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447083:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3145 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447087:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3145 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809579.447093:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809579.447168:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447172:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447177:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447180:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.447183:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447195:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447203:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809579.447205:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.447208:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447212:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447221:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447224:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447228:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447230:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.447232:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447235:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447238:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:1.0:1780809579.447240:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.447241:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447252:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f313e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447288:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687206e expref: 61 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447301:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3145 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687206e expref: 60 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.447306:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809579.447307:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809579.447309:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64200, rc 0) 00000100:00100000:1.0:1780809579.447352:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc1f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:142092:x1867312334947328:12345-192.168.203.33@tcp:101:dd.0 Request processed in 685us (810us total) trans 55834578525 rc 0/0 00000100:00100000:1.0:1780809579.447356:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7438 00000100:00100000:3.0:1780809579.448396:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.448437:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334947456 00000100:00100000:2.0:1780809579.448443:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334947456 00000100:00100000:2.0:1780809579.448478:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2111 00000100:00100000:2.0:1780809579.448487:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2393:x1867312334947456:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809579.448498:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809579.448511:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3145 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687206e expref: 60 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.448523:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809579.448527:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809579.448553:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2393:x1867312334947456:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.448560:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2111 00000100:00100000:3.0:1780809579.605231:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.605298:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334947712 00000100:00100000:1.0:1780809579.605310:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334947712 00000100:00100000:1.0:1780809579.605370:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7439 00000100:00100000:1.0:1780809579.605382:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142098:x1867312334947712:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809579.605407:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809579.605427:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872075 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605495:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605509:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605533:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605549:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605556:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605563:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605939:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3168 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605949:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3168 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.605957:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3168 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809579.605966:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809579.606060:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606072:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606079:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606085:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.606093:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606101:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606112:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809579.606115:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.606119:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606126:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f315a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606137:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606143:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606149:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606154:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.606157:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606163:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606170:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:1.0:1780809579.606172:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.606180:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606185:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f3161 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606220:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872075 expref: 62 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606232:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3168 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872075 expref: 61 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.606238:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809579.606240:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809579.606243:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64000, rc 0) 00000100:00100000:1.0:1780809579.606293:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:142098:x1867312334947712:12345-192.168.203.33@tcp:101:dd.0 Request processed in 913us (1067us total) trans 55834578526 rc 0/0 00000100:00100000:1.0:1780809579.606300:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7439 00000100:00100000:0.0:1780809579.607353:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809579.607385:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.607409:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334947840 00000100:00100000:2.0:1780809579.607415:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334947840 00000100:00100000:1.0:1780809579.607427:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334948096 00000100:00100000:1.0:1780809579.607432:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334948096 00000100:00100000:2.0:1780809579.607459:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2112 00000100:00100000:1.0:1780809579.607465:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1749 00000100:00100000:2.0:1780809579.607470:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:2393:x1867312334947840:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809579.607478:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142098:x1867312334948096:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809579.607480:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809579.607493:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3168 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872075 expref: 62 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.607502:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809579.607505:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809579.607528:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2393:x1867312334947840:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.607533:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2112 00000100:00100000:1.0:1780809579.607574:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:142098:x1867312334948096:12345-192.168.203.33@tcp:35:dd.0 Request processed in 99us (188us total) trans 55834578527 rc 0/0 00000100:00100000:1.0:1780809579.607580:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1749 00000100:00100000:3.0:1780809579.756374:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.756420:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334948352 00000100:00100000:1.0:1780809579.756428:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334948352 00000100:00100000:1.0:1780809579.756466:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1750 00000100:00100000:1.0:1780809579.756473:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:142092:x1867312334948352:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809579.756667:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142092:x1867312334948352:12345-192.168.203.33@tcp:35:dd.0 Request processed in 194us (300us total) trans 55834578528 rc 0/0 00000100:00100000:1.0:1780809579.756673:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1750 00000100:00100000:3.0:1780809579.849507:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.849564:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334948480 00000100:00100000:2.0:1780809579.849573:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334948480 00000100:00100000:2.0:1780809579.849647:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7440 00000100:00100000:2.0:1780809579.849657:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142113:x1867312334948480:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809579.849693:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809579.849711:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687207c expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.849770:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.849783:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.849795:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.849809:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.849827:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.849834:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.850158:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.850170:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 63 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.850178:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.850206:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 63 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.850220:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 63 pid: 77629 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809579.850234:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338740864:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809579.850300:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff9599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780809579.851027:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338740864:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809579.851045:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809579.851181:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.851226:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334948736 00000100:00100000:1.0:1780809579.851231:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334948736 00000100:00100000:1.0:1780809579.851263:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1751 00000100:00100000:1.0:1780809579.851270:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:89646:x1867312334948736:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809579.851397:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:89646:x1867312334948736:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 128us (217us total) trans 55834578529 rc 0/0 00000100:00100000:1.0:1780809579.851402:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1751 00000100:00100000:0.0:1780809579.851958:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.851990:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334948864 00000100:00100000:1.0:1780809579.851994:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334948864 00010000:00010000:1.0:1780809579.852018:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 65 pid: 77629 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809579.852038:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 525 00000100:00100000:1.0:1780809579.852043:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312334948864:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809579.852049:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809579.852054:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 65 pid: 77629 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.852063:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 65 pid: 77629 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.852076:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3122 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872067 expref: 65 pid: 77629 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.852098:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809579.852101:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.852106:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.852110:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.852123:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809579.852142:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2393:x1867312334948864:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 100us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809579.852147:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 525 00010000:00010000:2.0:1780809579.852160:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852175:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809579.852202:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809579.852207:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809579.852219:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852231:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852239:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852245:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852252:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852258:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809579.852262:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852270:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852279:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809579.852282:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809579.852286:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852301:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f317d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852322:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852329:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852334:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852339:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809579.852341:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852347:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852355:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809579.852358:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809579.852361:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852366:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3184 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852394:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 64 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852430:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 63 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.852437:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809579.852440:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809579.852442:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:2.0:1780809579.852473:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142113:x1867312334948480:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2818us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.852480:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7440 00000100:00100000:0.0:1780809579.853789:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.853818:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334949120 00000100:00100000:2.0:1780809579.853822:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334949120 00000100:00100000:2.0:1780809579.853850:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7441 00000100:00100000:2.0:1780809579.853855:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142113:x1867312334949120:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809579.853863:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809579.853870:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872083 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.853913:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.853924:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 64 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.853932:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.853950:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 64 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.853964:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 64 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809579.853971:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338740992:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809579.854016:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff9599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780809579.854623:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338740992:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809579.854635:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809579.854785:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.854815:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334949248 00000100:00100000:2.0:1780809579.854819:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334949248 00010000:00010000:2.0:1780809579.854832:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 65 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809579.854851:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 526 00000100:00100000:2.0:1780809579.854856:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2394:x1867312334949248:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809579.854861:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809579.854864:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 65 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.854872:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 65 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.854882:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f318b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687207c expref: 65 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.854904:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809579.854908:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.854915:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.854921:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.854940:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809579.854956:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.854963:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809579.854971:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2394:x1867312334949248:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 112us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.854980:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 526 00000004:00200000:1.0:1780809579.854981:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809579.855074:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 65 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.855091:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 64 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.855099:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809579.855107:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809579.855110:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:1.0:1780809579.855140:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142113:x1867312334949120:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1285us (1351us total) trans 55834578530 rc 0/0 00000100:00100000:1.0:1780809579.855146:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7441 00000100:00100000:0.0:1780809579.880351:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.880406:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334949504 00000100:00100000:1.0:1780809579.880416:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334949504 00000100:00100000:1.0:1780809579.880459:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7442 00000100:00100000:1.0:1780809579.880466:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc8634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142120:x1867312334949504:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809579.880485:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809579.880503:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f31a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687208a expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880568:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880582:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880614:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880628:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880635:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880641:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880904:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f31bc lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880912:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f31bc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.880919:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f31bc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809579.880929:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809579.881025:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881031:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881035:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881039:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.881042:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881047:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881055:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809579.881057:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.881060:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881070:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f31ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881078:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881081:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881085:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881088:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809579.881090:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881093:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881097:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:1.0:1780809579.881098:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809579.881100:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881103:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f31b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881129:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f31a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687208a expref: 67 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881150:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f31bc lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687208a expref: 66 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809579.881155:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809579.881157:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809579.881158:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65a00, rc 0) 00000100:00100000:1.0:1780809579.881198:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc8634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:142120:x1867312334949504:12345-192.168.203.33@tcp:101:dd.0 Request processed in 733us (857us total) trans 55834578531 rc 0/0 00000100:00100000:1.0:1780809579.881203:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7442 00000100:00100000:3.0:1780809579.882134:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809579.882182:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334949632 00000100:00100000:2.0:1780809579.882188:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334949632 00000100:00100000:2.0:1780809579.882218:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2113 00000100:00100000:2.0:1780809579.882226:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2393:x1867312334949632:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809579.882237:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809579.882250:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f31bc lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687208a expref: 66 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809579.882262:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809579.882267:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809579.882293:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312334949632:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.882298:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2113 00000100:00100000:1.0:1780809579.891721:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338741120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780809579.891776:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809579.891811:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338741120 00000100:00100000:2.0:1780809579.891818:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338741120 00000100:00100000:2.0:1780809579.891857:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1780809579.891864:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338741120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780809579.891899:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:2.0:1780809579.891944:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338741120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809579.891949:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1780809579.891999:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338741120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780809579.952801:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809579.952848:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334949888 00000100:00100000:0.0:1780809579.952856:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334949888 00000100:00100000:0.0:1780809579.952906:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7443 00000100:00100000:0.0:1780809579.952912:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:142126:x1867312334949888:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809579.952930:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809579.952946:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f31ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872091 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953015:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953028:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953039:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953065:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953072:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953077:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953364:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f31df lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953371:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f31df lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953375:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f31df lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809579.953382:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809579.953441:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953445:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953450:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953453:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809579.953456:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953469:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953477:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809579.953479:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809579.953482:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953486:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f31d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953498:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953502:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953505:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953508:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809579.953509:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953513:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953516:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809579.953517:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809579.953519:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953528:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f31d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953555:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f31ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872091 expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953564:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f31df lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872091 expref: 67 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809579.953568:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809579.953570:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809579.953571:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf800, rc 0) 00000100:00100000:0.0:1780809579.953641:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142126:x1867312334949888:12345-192.168.203.33@tcp:101:dd.0 Request processed in 730us (850us total) trans 55834578532 rc 0/0 00000100:00100000:0.0:1780809579.953647:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7443 00000100:00100000:0.0:1780809579.954711:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809579.954734:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809579.954754:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334950016 00000100:00100000:1.0:1780809579.954759:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334950016 00000100:00100000:2.0:1780809579.954780:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334950272 00000100:00100000:2.0:1780809579.954786:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334950272 00000100:00100000:1.0:1780809579.954790:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2114 00000100:00100000:1.0:1780809579.954798:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2394:x1867312334950016:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809579.954807:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809579.954819:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f31df lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872091 expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809579.954827:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1752 00010000:00010000:1.0:1780809579.954836:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00000100:00100000:2.0:1780809579.954838:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142126:x1867312334950272:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809579.954840:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809579.954867:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:2394:x1867312334950016:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809579.954880:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2114 00000100:00100000:2.0:1780809579.954964:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142126:x1867312334950272:12345-192.168.203.33@tcp:35:dd.0 Request processed in 128us (226us total) trans 55834578533 rc 0/0 00000100:00100000:2.0:1780809579.954971:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1752 00010000:00010000:0.0:1780809580.083709:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809580.179257:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.179303:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334950528 00000100:00100000:1.0:1780809580.179312:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334950528 00000100:00100000:1.0:1780809580.179372:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1753 00000100:00100000:1.0:1780809580.179381:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142120:x1867312334950528:12345-192.168.203.33@tcp:35:dd.0 00000100:00080000:2.0:1780809580.179383:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780809580.179580:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142120:x1867312334950528:12345-192.168.203.33@tcp:35:dd.0 Request processed in 199us (329us total) trans 55834578534 rc 0/0 00000100:00100000:1.0:1780809580.179614:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1753 00000100:00100000:1.0:1780809580.399391:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809580.399452:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334950784 00000100:00100000:2.0:1780809580.399462:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334950784 00000100:00100000:2.0:1780809580.399515:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7444 00000100:00100000:2.0:1780809580.399525:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142134:x1867312334950784:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809580.399553:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809580.399571:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f31ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872098 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.399678:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.399694:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.399711:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.399726:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.399733:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.399740:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400098:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3202 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400108:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3202 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400115:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3202 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809580.400126:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809580.400227:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400235:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400241:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400249:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809580.400258:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400266:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400278:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809580.400281:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809580.400286:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400292:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f31f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400318:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400325:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400331:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400335:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809580.400338:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400343:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400350:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809580.400353:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809580.400361:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400367:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f31fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400412:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f31ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872098 expref: 71 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400428:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3202 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872098 expref: 70 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.400436:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809580.400438:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809580.400441:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e400, rc 0) 00000100:00100000:2.0:1780809580.400492:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:142134:x1867312334950784:12345-192.168.203.33@tcp:101:dd.0 Request processed in 969us (1107us total) trans 55834578535 rc 0/0 00000100:00100000:2.0:1780809580.400499:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7444 00000100:00100000:3.0:1780809580.401540:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809580.401582:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334950912 00000100:00100000:2.0:1780809580.401604:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334950912 00000100:00100000:2.0:1780809580.401637:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2115 00000100:00100000:2.0:1780809580.401646:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:2393:x1867312334950912:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809580.401656:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809580.401669:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3202 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872098 expref: 70 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.401684:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809580.401688:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809580.401721:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:2393:x1867312334950912:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809580.401728:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2115 00000100:00100000:1.0:1780809580.403699:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780809580.403714:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338741248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809580.403747:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809580.403784:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338741248 00000100:00100000:2.0:1780809580.403790:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338741248 00000100:00100000:2.0:1780809580.403831:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1780809580.403841:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338741248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780809580.403857:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809580.403903:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338741248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809580.403912:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1780809580.403928:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338741248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780809580.509642:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.509702:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334951168 00000100:00100000:1.0:1780809580.509711:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334951168 00000100:00100000:1.0:1780809580.509755:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7445 00000100:00100000:1.0:1780809580.509762:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:142140:x1867312334951168:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809580.509782:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809580.509796:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3210 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687209f expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.509873:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.509889:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.509906:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.509917:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.509921:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.509925:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510195:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3225 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510202:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3225 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510206:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3225 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809580.510220:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809580.510288:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510293:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510297:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510301:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809580.510307:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510312:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510321:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809580.510323:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809580.510326:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510330:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510338:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510341:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510344:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510347:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809580.510349:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510352:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510356:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:1.0:1780809580.510357:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809580.510361:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510365:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f321e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510393:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3210 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687209f expref: 72 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510401:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3225 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687209f expref: 71 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.510405:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809580.510406:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809580.510408:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65000, rc 0) 00000100:00100000:1.0:1780809580.510454:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142140:x1867312334951168:12345-192.168.203.33@tcp:101:dd.0 Request processed in 692us (819us total) trans 55834578536 rc 0/0 00000100:00100000:1.0:1780809580.510460:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7445 00000100:00100000:1.0:1780809580.511458:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.511482:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809580.511517:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334951296 00000100:00100000:2.0:1780809580.511523:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334951296 00000100:00100000:3.0:1780809580.511532:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334951552 00000100:00100000:3.0:1780809580.511537:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334951552 00000100:00100000:3.0:1780809580.511565:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1754 00000100:00100000:2.0:1780809580.511573:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2116 00000100:00100000:3.0:1780809580.511574:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142140:x1867312334951552:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809580.511628:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2394:x1867312334951296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809580.511640:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809580.511684:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3225 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687209f expref: 73 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809580.511699:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142140:x1867312334951552:12345-192.168.203.33@tcp:35:dd.0 Request processed in 127us (214us total) trans 55834578537 rc 0/0 00010000:00010000:2.0:1780809580.511699:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809580.511707:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809580.511716:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1754 00000100:00100000:2.0:1780809580.511746:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2394:x1867312334951296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 161us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809580.511761:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2116 00000100:00100000:3.0:1780809580.581046:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809580.581100:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334951680 00000100:00100000:2.0:1780809580.581109:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334951680 00000100:00100000:2.0:1780809580.581152:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7446 00000100:00100000:2.0:1780809580.581176:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142147:x1867312334951680:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809580.581200:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809580.581224:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720a6 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581277:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581289:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581296:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581308:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581314:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581321:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581582:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581621:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 72 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581627:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581662:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 72 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.581672:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 72 pid: 78216 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809580.581682:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338741376:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809580.581741:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadff959240 going to sleep for 11 seconds 00000100:00100000:2.0:1780809580.582546:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338741376:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809580.582559:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809580.582738:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.582782:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334951936 00000100:00100000:1.0:1780809580.582788:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334951936 00000100:00100000:1.0:1780809580.582824:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1755 00000100:00100000:1.0:1780809580.582833:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:89645:x1867312334951936:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809580.582990:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:89645:x1867312334951936:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 157us (249us total) trans 55834578538 rc 0/0 00000100:00100000:1.0:1780809580.583011:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1755 00000100:00100000:0.0:1780809580.583632:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.583678:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334952064 00000100:00100000:1.0:1780809580.583691:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334952064 00010000:00010000:1.0:1780809580.583711:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 74 pid: 78216 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809580.583740:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 527 00000100:00100000:1.0:1780809580.583748:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2393:x1867312334952064:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809580.583758:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809580.583764:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 74 pid: 78216 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.583776:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 74 pid: 78216 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.583794:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3199 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872083 expref: 74 pid: 78216 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.583819:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809580.583823:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.583832:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.583838:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.583857:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809580.583880:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809580.583888:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2393:x1867312334952064:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (255us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809580.583890:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809580.583911:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 527 00000004:00200000:2.0:1780809580.583919:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809580.583924:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809580.583939:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.583949:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.583958:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.583974:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.583981:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.583987:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809580.583991:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584011:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584019:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809580.584021:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809580.584024:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584028:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f323a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584044:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584048:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584051:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584055:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809580.584061:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584065:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584069:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809580.584071:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809580.584073:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584076:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584100:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 73 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584108:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 72 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809580.584113:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809580.584114:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809580.584116:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f200, rc 0) 00000100:00100000:2.0:1780809580.584143:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142147:x1867312334951680:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2971us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809580.584147:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7446 00000100:00100000:2.0:1780809580.585465:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.585497:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334952320 00000100:00100000:1.0:1780809580.585501:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334952320 00000100:00100000:1.0:1780809580.585526:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7447 00000100:00100000:1.0:1780809580.585531:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142147:x1867312334952320:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809580.585542:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809580.585551:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f324f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720ad expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.585616:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.585624:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 73 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.585629:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.585647:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 73 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.585654:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 73 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809580.585662:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338741504:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809580.585703:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd1316480 going to sleep for 11 seconds 00000100:00100000:1.0:1780809580.586330:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338741504:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809580.586346:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809580.586605:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809580.586671:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334952448 00000100:00100000:0.0:1780809580.586676:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334952448 00010000:00010000:0.0:1780809580.586696:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 74 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809580.586723:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 528 00000100:00100000:0.0:1780809580.586736:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2394:x1867312334952448:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809580.586743:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809580.586747:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 74 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.586756:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 74 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.586766:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3248 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720a6 expref: 74 pid: 79214 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.586781:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809580.586784:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.586789:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.586794:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.586807:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809580.586824:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809580.586832:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2394:x1867312334952448:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 95us (241us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809580.586835:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809580.586843:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 528 00000004:00200000:1.0:1780809580.586852:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809580.586930:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f324f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 74 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.586939:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 73 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.586943:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809580.586945:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809580.586947:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65600, rc 0) 00000100:00100000:1.0:1780809580.586973:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142147:x1867312334952320:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1442us (1510us total) trans 55834578539 rc 0/0 00000100:00100000:1.0:1780809580.586978:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7447 00000100:00100000:2.0:1780809580.684181:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809580.684231:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334952704 00000100:00100000:3.0:1780809580.684240:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334952704 00000100:00100000:3.0:1780809580.684281:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1756 00000100:00100000:3.0:1780809580.684289:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142134:x1867312334952704:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809580.684469:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:142134:x1867312334952704:12345-192.168.203.33@tcp:35:dd.0 Request processed in 181us (295us total) trans 55834578540 rc 0/0 00000100:00100000:3.0:1780809580.684475:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1756 00000100:00100000:3.0:1780809580.753057:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809580.753109:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334952960 00000100:00100000:0.0:1780809580.753119:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334952960 00000100:00100000:0.0:1780809580.753173:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7448 00000100:00100000:0.0:1780809580.753183:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:142162:x1867312334952960:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809580.753220:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809580.753238:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3264 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720b4 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753304:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753319:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753331:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753343:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753350:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753356:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753723:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3279 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753733:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3279 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753740:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3279 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809580.753750:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809580.753834:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753843:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753850:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753856:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809580.753860:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753868:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753878:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809580.753881:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809580.753886:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753891:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f326b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753907:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753912:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753917:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753932:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809580.753935:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753941:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753948:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809580.753950:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809580.753953:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.753963:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3272 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.754014:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3264 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720b4 expref: 77 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.754028:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3279 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720b4 expref: 76 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.754035:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809580.754038:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809580.754040:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf600, rc 0) 00000100:00100000:0.0:1780809580.754089:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142162:x1867312334952960:12345-192.168.203.33@tcp:101:dd.0 Request processed in 909us (1040us total) trans 55834578541 rc 0/0 00000100:00100000:0.0:1780809580.754097:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7448 00000100:00100000:2.0:1780809580.755194:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809580.755235:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334953088 00000100:00100000:0.0:1780809580.755246:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334953088 00000100:00100000:0.0:1780809580.755279:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2117 00000100:00100000:0.0:1780809580.755285:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:2393:x1867312334953088:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809580.755296:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809580.755310:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3279 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720b4 expref: 76 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.755322:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809580.755326:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809580.755352:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:2393:x1867312334953088:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 67us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809580.755358:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2117 00000100:00100000:2.0:1780809580.811618:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809580.811660:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334953344 00000100:00100000:0.0:1780809580.811670:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334953344 00000100:00100000:0.0:1780809580.811713:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7449 00000100:00100000:0.0:1780809580.811721:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:142168:x1867312334953344:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809580.811738:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809580.811754:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720bb expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.811807:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.811818:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.811825:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.811848:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.811853:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.811857:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812183:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f329c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812190:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f329c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812194:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f329c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809580.812201:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809580.812267:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812272:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812277:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812280:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809580.812283:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812295:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812303:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809580.812305:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809580.812308:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812312:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f328e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812325:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812329:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812332:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812335:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809580.812336:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812340:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812343:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83f00) 00010000:00010000:0.0:1780809580.812344:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809580.812346:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812354:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812382:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720bb expref: 78 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812391:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f329c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720bb expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809580.812396:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809580.812397:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809580.812399:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce800, rc 0) 00000100:00100000:0.0:1780809580.812442:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142168:x1867312334953344:12345-192.168.203.33@tcp:101:dd.0 Request processed in 722us (858us total) trans 55834578542 rc 0/0 00000100:00100000:0.0:1780809580.812447:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7449 00000100:00100000:3.0:1780809580.813454:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809580.813507:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.813512:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334953472 00000100:00100000:1.0:1780809580.813519:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334953472 00000100:00100000:2.0:1780809580.813544:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334953728 00000100:00100000:2.0:1780809580.813548:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334953728 00000100:00100000:1.0:1780809580.813572:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2118 00000100:00100000:2.0:1780809580.813578:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1757 00000100:00100000:1.0:1780809580.813583:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2392:x1867312334953472:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1780809580.813615:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:142168:x1867312334953728:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809580.813627:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809580.813642:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f329c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720bb expref: 78 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.813668:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809580.813673:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809580.813710:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2392:x1867312334953472:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 130us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809580.813718:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2118 00000100:00100000:2.0:1780809580.813726:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:142168:x1867312334953728:12345-192.168.203.33@tcp:35:dd.0 Request processed in 139us (218us total) trans 55834578543 rc 0/0 00000100:00100000:2.0:1780809580.813734:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1757 00000040:00080000:2.0:1780809580.916150:0:78218:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1780809580.960674:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809580.960721:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334953984 00000100:00100000:1.0:1780809580.960730:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334953984 00000100:00100000:1.0:1780809580.960775:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7450 00000100:00100000:1.0:1780809580.960783:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142175:x1867312334953984:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809580.960804:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809580.960820:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f32aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720c2 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.960874:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.960885:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.960892:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.960901:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.960905:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.960923:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961227:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f32bf lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961233:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f32bf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961238:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f32bf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809580.961246:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809580.961311:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961316:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961320:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961324:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809580.961327:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961331:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961339:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809580.961341:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809580.961348:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961352:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961360:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961363:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961367:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961370:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809580.961371:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961374:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961378:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:1.0:1780809580.961379:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809580.961381:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961383:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961411:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f32aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720c2 expref: 80 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961427:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f32bf lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720c2 expref: 79 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809580.961432:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809580.961433:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809580.961435:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64000, rc 0) 00000100:00100000:1.0:1780809580.961478:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142175:x1867312334953984:12345-192.168.203.33@tcp:101:dd.0 Request processed in 696us (812us total) trans 55834578544 rc 0/0 00000100:00100000:1.0:1780809580.961482:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7450 00000100:00100000:0.0:1780809580.962542:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809580.962604:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334954112 00000100:00100000:2.0:1780809580.962609:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334954112 00000100:00100000:0.0:1780809580.962621:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809580.962643:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2119 00000100:00100000:2.0:1780809580.962650:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2391:x1867312334954112:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809580.962659:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809580.962670:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334954368 00010000:00010000:2.0:1780809580.962671:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f32bf lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720c2 expref: 79 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809580.962675:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334954368 00010000:00010000:2.0:1780809580.962686:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809580.962689:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809580.962710:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1758 00000100:00100000:3.0:1780809580.962717:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142175:x1867312334954368:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809580.962734:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2391:x1867312334954112:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809580.962742:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2119 00000100:00100000:3.0:1780809580.962826:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142175:x1867312334954368:12345-192.168.203.33@tcp:35:dd.0 Request processed in 109us (206us total) trans 55834578545 rc 0/0 00000100:00100000:3.0:1780809580.962831:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1758 00000100:00100000:0.0:1780809581.053822:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809581.053871:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809581.053892:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809581.053893:0:77620:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334954496 00000100:00100000:2.0:1780809581.053905:0:77620:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334954496 00000100:00100000:0.0:1780809581.053910:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.053926:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334954624 00000100:00100000:1.0:1780809581.053932:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334954624 00000100:00100000:0.0:1780809581.053947:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809581.053955:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334954880 00000100:00100000:3.0:1780809581.053962:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334954880 00000100:00100000:2.0:1780809581.053973:0:77620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 383 00000100:00100000:2.0:1780809581.053989:0:77620:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312334954496:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809581.053991:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334955136 00000100:00100000:0.0:1780809581.054002:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.054005:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334955136 00000100:00100000:3.0:1780809581.054020:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334954752 00000100:00100000:3.0:1780809581.054025:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334954752 00000100:00100000:1.0:1780809581.054034:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1075 00000100:00100000:0.0:1780809581.054037:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334955008 00000100:00100000:0.0:1780809581.054043:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334955008 00000100:00100000:1.0:1780809581.054047:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312334954624:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809581.054063:0:78803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 650 00000100:00100000:3.0:1780809581.054075:0:78803:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312334954880:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809581.054093:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1076 00000100:00100000:2.0:1780809581.054099:0:77620:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312334954496:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809581.054107:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1077 00000100:00100000:0.0:1780809581.054110:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312334955136:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809581.054116:0:77620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 383 00000100:00100000:3.0:1780809581.054124:0:78803:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312334954880:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809581.054124:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312334955008:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809581.054139:0:78803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 650 00000100:00100000:0.0:1780809581.054162:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312334955136:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 57us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809581.054169:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 651 00000100:00100000:1.0:1780809581.054170:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312334955008:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 49us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809581.054177:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1076 00000100:00100000:2.0:1780809581.054186:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2392:x1867312334954752:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809581.054186:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1077 00000100:00100000:2.0:1780809581.054224:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2392:x1867312334954752:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00080000:3.0:1780809581.054227:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780809581.054233:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780809581.054233:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 651 00000100:00080000:3.0:1780809581.054239:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780809581.054241:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780809581.054342:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312334954624:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 175us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809581.054350:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1075 00000100:00100000:1.0:1780809581.054541:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809581.054622:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334955392 00000100:00100000:2.0:1780809581.054627:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334955392 00000100:00100000:2.0:1780809581.054653:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1759 00000100:00100000:2.0:1780809581.054658:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142162:x1867312334955392:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809581.054832:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:142162:x1867312334955392:12345-192.168.203.33@tcp:35:dd.0 Request processed in 173us (291us total) trans 55834578546 rc 0/0 00000100:00100000:2.0:1780809581.054837:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1759 00010000:00010000:1.0:1780809581.107716:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809581.225523:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809581.225579:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334955648 00000100:00100000:2.0:1780809581.225605:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334955648 00000100:00100000:2.0:1780809581.225646:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7451 00000100:00100000:2.0:1780809581.225654:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:142189:x1867312334955648:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809581.225672:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809581.225687:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f32cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720c9 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.225746:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.225769:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.225777:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.225786:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.225790:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.225794:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226070:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f32e2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226079:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f32e2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226086:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f32e2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809581.226096:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809581.226173:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226179:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226183:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226193:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809581.226196:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226200:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226208:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809581.226210:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809581.226213:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226217:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f32d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226236:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226239:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226243:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226246:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809581.226247:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226251:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226260:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809581.226262:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809581.226263:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226267:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f32db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226301:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f32cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720c9 expref: 83 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226311:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f32e2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720c9 expref: 82 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.226315:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809581.226316:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809581.226317:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:2.0:1780809581.226361:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142189:x1867312334955648:12345-192.168.203.33@tcp:101:dd.0 Request processed in 707us (843us total) trans 55834578547 rc 0/0 00000100:00100000:2.0:1780809581.226368:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7451 00000100:00100000:0.0:1780809581.227371:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.227407:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334955904 00000100:00100000:1.0:1780809581.227411:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334955904 00000100:00100000:0.0:1780809581.227426:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.227448:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7452 00000100:00100000:2.0:1780809581.227463:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334955776 00000100:00100000:1.0:1780809581.227464:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142188:x1867312334955904:12345-192.168.203.33@tcp:101:lfs.0 00000100:00100000:2.0:1780809581.227467:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334955776 00010000:00010000:1.0:1780809581.227480:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809581.227492:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720d0 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809581.227504:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2120 00000100:00100000:2.0:1780809581.227515:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadd9de6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2394:x1867312334955776:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809581.227523:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.227526:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809581.227532:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227539:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.227542:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f32e2 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720c9 expref: 84 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227550:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227568:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227574:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.227576:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809581.227580:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809581.227622:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadd9de6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2394:x1867312334955776:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 112us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809581.227628:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2120 00010000:00010000:1.0:1780809581.227811:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227819:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 82 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227829:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227851:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 82 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.227861:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 82 pid: 78216 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.227870:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338741632:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809581.227913:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd1316480 going to sleep for 11 seconds 00000100:00100000:1.0:1780809581.228545:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338741632:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809581.228561:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809581.228638:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809581.228670:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334956160 00000100:00100000:3.0:1780809581.228675:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334956160 00000100:00100000:3.0:1780809581.228699:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1760 00000100:00100000:3.0:1780809581.228705:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:89645:x1867312334956160:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809581.228807:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:89645:x1867312334956160:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 102us (169us total) trans 55834578548 rc 0/0 00000100:00100000:3.0:1780809581.228813:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1760 00000100:00100000:0.0:1780809581.229329:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.229362:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334956288 00000100:00100000:1.0:1780809581.229366:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334956288 00010000:00010000:1.0:1780809581.229378:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 84 pid: 78216 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.229397:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 529 00000100:00100000:1.0:1780809581.229401:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312334956288:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809581.229407:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809581.229411:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 84 pid: 78216 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.229427:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 84 pid: 78216 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.229436:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3256 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ad expref: 84 pid: 78216 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.229443:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809581.229446:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.229450:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.229454:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.229467:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809581.229487:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2393:x1867312334956288:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 86us (158us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809581.229489:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.229496:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 529 00010000:00010000:2.0:1780809581.229505:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809581.229527:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809581.229531:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809581.229540:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229547:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229552:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229556:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229560:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229564:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809581.229565:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229576:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229582:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809581.229584:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809581.229586:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229604:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f32f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229613:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229617:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229621:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229624:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809581.229625:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229628:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229632:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fd00) 00010000:00010000:2.0:1780809581.229634:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809581.229635:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229645:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f32fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229662:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f32f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 83 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229669:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 82 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.229674:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809581.229675:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809581.229677:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:2.0:1780809581.229700:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142188:x1867312334955904:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2241us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809581.229705:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7452 00000100:00100000:0.0:1780809581.230918:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809581.230958:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334956544 00000100:00100000:3.0:1780809581.230963:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334956544 00000100:00100000:3.0:1780809581.231003:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7453 00000100:00100000:3.0:1780809581.231011:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142188:x1867312334956544:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809581.231022:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809581.231032:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f330c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720d7 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.231075:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.231083:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 83 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.231096:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.231111:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 83 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.231118:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 83 pid: 77628 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809581.231125:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338741760:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809581.231162:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd00abe40 going to sleep for 11 seconds 00000100:00100000:3.0:1780809581.231700:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338741760:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809581.231710:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809581.231844:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809581.231869:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334956672 00000100:00100000:2.0:1780809581.231872:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334956672 00010000:00010000:2.0:1780809581.231886:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 84 pid: 77628 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809581.231904:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 530 00000100:00100000:2.0:1780809581.231909:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312334956672:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809581.231916:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809581.231919:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 84 pid: 77628 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.231934:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 84 pid: 77628 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.231943:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3305 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d0 expref: 84 pid: 77628 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.231950:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809581.231953:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.231957:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.231961:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.231973:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809581.232003:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2393:x1867312334956672:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 83us (148us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809581.232005:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809581.232012:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 530 00010000:00010000:3.0:1780809581.232019:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809581.232030:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809581.232084:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f330c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 84 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.232093:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 83 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.232107:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809581.232109:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809581.232111:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809581.232134:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:142188:x1867312334956544:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1126us (1218us total) trans 55834578549 rc 0/0 00000100:00100000:3.0:1780809581.232139:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7453 00000100:00100000:0.0:1780809581.383644:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.383691:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334956928 00000100:00100000:1.0:1780809581.383711:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334956928 00000100:00100000:1.0:1780809581.383774:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7454 00000100:00100000:1.0:1780809581.383786:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:142196:x1867312334956928:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809581.383809:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809581.383829:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720de expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.383915:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.383929:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.383940:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.383957:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.383965:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.383973:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384455:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3336 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384465:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3336 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384473:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3336 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809581.384482:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809581.384568:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384580:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384585:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384604:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809581.384608:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384613:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384623:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809581.384625:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809581.384628:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384632:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384641:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384645:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384649:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384652:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809581.384658:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384663:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384669:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479ff00) 00010000:00010000:1.0:1780809581.384671:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809581.384674:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384677:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f332f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384715:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720de expref: 86 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384731:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3336 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720de expref: 85 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.384739:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809581.384741:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809581.384745:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:1.0:1780809581.384795:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:142196:x1867312334956928:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1012us (1158us total) trans 55834578550 rc 0/0 00000100:00100000:1.0:1780809581.384801:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7454 00000100:00100000:1.0:1780809581.385852:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.385882:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334957056 00000100:00100000:1.0:1780809581.385887:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334957056 00000100:00100000:1.0:1780809581.385928:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2121 00000100:00100000:1.0:1780809581.385946:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:2392:x1867312334957056:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1780809581.385957:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:1.0:1780809581.385970:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809581.385987:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3336 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720de expref: 85 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.386013:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809581.386018:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809581.386052:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2392:x1867312334957056:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 109us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809581.386061:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2121 00000100:00100000:1.0:1780809581.386100:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334957312 00000100:00100000:1.0:1780809581.386105:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334957312 00000100:00100000:1.0:1780809581.386149:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1761 00000100:00100000:1.0:1780809581.386157:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:142196:x1867312334957312:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809581.386285:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:142196:x1867312334957312:12345-192.168.203.33@tcp:35:dd.0 Request processed in 130us (332us total) trans 55834578551 rc 0/0 00000100:00100000:1.0:1780809581.386291:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1761 00000001:00080000:2.0:1780809581.443456:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578542 is committed 00000001:00080000:2.0:1780809581.443513:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578551 is committed 00000100:00100000:0.0:1780809581.525671:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809581.525722:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334957568 00000100:00100000:3.0:1780809581.525730:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334957568 00000100:00100000:3.0:1780809581.525787:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1762 00000100:00100000:3.0:1780809581.525796:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+17:142189:x1867312334957568:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809581.526034:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:142189:x1867312334957568:12345-192.168.203.33@tcp:35:dd.0 Request processed in 239us (371us total) trans 55834578552 rc 0/0 00000100:00100000:3.0:1780809581.526043:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1762 00000100:00100000:2.0:1780809581.535218:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809581.535276:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334957824 00000100:00100000:3.0:1780809581.535285:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334957824 00000100:00100000:3.0:1780809581.535335:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7455 00000100:00100000:3.0:1780809581.535350:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:142203:x1867312334957824:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809581.535372:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809581.535390:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3344 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720e5 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535451:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535464:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535485:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535499:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535507:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535513:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535864:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3359 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535874:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3359 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535881:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3359 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809581.535891:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809581.535966:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535975:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535982:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.535987:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809581.536030:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536038:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536049:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809581.536052:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809581.536057:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536064:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f334b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536077:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536083:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536089:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536093:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809581.536096:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536102:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536109:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809581.536112:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809581.536120:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536127:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3352 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536166:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3344 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720e5 expref: 21 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536180:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3359 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720e5 expref: 20 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809581.536188:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809581.536191:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809581.536194:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809581.536243:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142203:x1867312334957824:12345-192.168.203.33@tcp:101:dd.0 Request processed in 896us (1028us total) trans 55834578553 rc 0/0 00000100:00100000:3.0:1780809581.536251:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7455 00000100:00100000:0.0:1780809581.537177:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.537217:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334957952 00000100:00100000:1.0:1780809581.537221:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334957952 00000100:00100000:1.0:1780809581.537249:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2122 00000100:00100000:1.0:1780809581.537254:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2391:x1867312334957952:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809581.537262:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809581.537272:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3359 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720e5 expref: 20 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.537281:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809581.537289:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809581.537314:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2391:x1867312334957952:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809581.537319:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2122 00000100:00100000:0.0:1780809581.814179:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.814234:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334958208 00000100:00100000:1.0:1780809581.814244:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334958208 00000100:00100000:1.0:1780809581.814295:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1763 00000100:00100000:1.0:1780809581.814306:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:142203:x1867312334958208:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809581.814514:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142203:x1867312334958208:12345-192.168.203.33@tcp:35:dd.0 Request processed in 210us (340us total) trans 55834578554 rc 0/0 00000100:00100000:1.0:1780809581.814523:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1763 00000100:00100000:2.0:1780809581.959204:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.959263:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334958464 00000100:00100000:1.0:1780809581.959273:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334958464 00000100:00100000:1.0:1780809581.959325:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7456 00000100:00100000:1.0:1780809581.959335:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccabb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142221:x1867312334958464:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809581.959369:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809581.959389:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720ec expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959455:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959468:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959479:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959507:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959514:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959520:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959875:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f337c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959885:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f337c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.959892:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f337c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809581.959902:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809581.960002:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960009:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960015:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960021:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809581.960025:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960041:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960052:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809581.960054:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809581.960059:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960065:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f336e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960077:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960082:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960087:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960092:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809581.960094:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960100:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960106:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479ff00) 00010000:00010000:1.0:1780809581.960108:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809581.960111:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960124:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3375 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960158:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ec expref: 23 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960170:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f337c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ec expref: 22 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.960176:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809581.960178:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809581.960181:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65c00, rc 0) 00000100:00100000:1.0:1780809581.960233:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccabb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142221:x1867312334958464:12345-192.168.203.33@tcp:101:dd.0 Request processed in 899us (1036us total) trans 55834578555 rc 0/0 00000100:00100000:1.0:1780809581.960240:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7456 00000100:00100000:0.0:1780809581.961276:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809581.961313:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809581.961321:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334958592 00000100:00100000:2.0:1780809581.961327:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334958592 00000100:00100000:1.0:1780809581.961363:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334958720 00000100:00100000:1.0:1780809581.961368:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334958720 00000100:00100000:2.0:1780809581.961384:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2123 00000100:00100000:2.0:1780809581.961395:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2392:x1867312334958592:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809581.961401:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7457 00000100:00100000:1.0:1780809581.961416:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:142224:x1867312334958720:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809581.961417:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809581.961432:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809581.961437:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f337c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720ec expref: 23 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961445:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f338a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720f3 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.961450:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809581.961457:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809581.961490:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809581.961493:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2392:x1867312334958592:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809581.961509:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2123 00010000:00010000:1.0:1780809581.961511:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961528:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961541:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961547:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961551:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961807:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961819:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 22 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961827:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961857:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 22 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.961870:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 22 pid: 79214 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.961882:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338741888:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809581.961941:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd13169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780809581.962651:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338741888:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809581.962670:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809581.962879:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809581.962913:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334958976 00000100:00100000:3.0:1780809581.962918:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334958976 00000100:00100000:3.0:1780809581.962948:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1764 00000100:00100000:3.0:1780809581.962968:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:89645:x1867312334958976:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809581.963124:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:89645:x1867312334958976:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 168us (244us total) trans 55834578556 rc 0/0 00000100:00100000:3.0:1780809581.963132:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1764 00000100:00100000:0.0:1780809581.963733:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.963768:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334959104 00000100:00100000:1.0:1780809581.963773:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334959104 00010000:00010000:1.0:1780809581.963792:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 24 pid: 79214 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.963818:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 531 00000100:00100000:1.0:1780809581.963827:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2393:x1867312334959104:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809581.963836:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809581.963842:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 24 pid: 79214 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.963854:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 24 pid: 79214 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.963869:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3313 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720d7 expref: 24 pid: 79214 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.963880:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809581.963885:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.963893:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.963900:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.963931:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809581.963958:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.963968:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2393:x1867312334959104:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 140us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809581.963971:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.963981:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 531 00000004:00200000:0.0:1780809581.964011:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809581.964017:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809581.964029:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964045:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964088:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964093:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964097:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964100:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809581.964103:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964107:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964114:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809581.964115:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809581.964118:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964121:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964127:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964131:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964139:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964142:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809581.964144:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964147:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964151:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f500) 00010000:00010000:0.0:1780809581.964153:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809581.964154:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964157:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3398 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964185:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f338a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964193:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 22 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809581.964197:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809581.964199:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809581.964200:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65800, rc 0) 00000100:00100000:0.0:1780809581.964223:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142224:x1867312334958720:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2813us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809581.964233:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7457 00000100:00100000:0.0:1780809581.966033:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809581.966063:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334959360 00000100:00100000:2.0:1780809581.966068:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334959360 00000100:00100000:2.0:1780809581.966095:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7458 00000100:00100000:2.0:1780809581.966100:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142224:x1867312334959360:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809581.966112:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809581.966121:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f33a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468720fa expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.966170:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.966178:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.966183:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.966200:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.966217:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 23 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809581.966226:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4370000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338742016:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809581.966267:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551d900 going to sleep for 11 seconds 00000100:00100000:2.0:1780809581.966906:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4370000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338742016:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809581.966917:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809581.967196:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809581.967236:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334959488 00000100:00100000:1.0:1780809581.967241:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334959488 00010000:00010000:1.0:1780809581.967261:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 24 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.967288:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 532 00000100:00100000:1.0:1780809581.967298:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadd9de5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2394:x1867312334959488:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809581.967306:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809581.967311:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 24 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.967319:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 24 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.967330:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f339f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720f3 expref: 24 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.967338:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809581.967340:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.967346:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.967355:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809581.967369:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809581.967391:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadd9de5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2394:x1867312334959488:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 96us (196us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809581.967395:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809581.967397:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 532 00010000:00010000:2.0:1780809581.967406:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809581.967418:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809581.967515:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f33a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 24 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.967539:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 23 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809581.967547:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809581.967549:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809581.967552:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ec00, rc 0) 00000100:00100000:2.0:1780809581.967581:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:142224:x1867312334959360:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1480us (1550us total) trans 55834578557 rc 0/0 00000100:00100000:2.0:1780809581.967617:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7458 00010000:00010000:0.0:1780809582.131722:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809582.142624:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.142690:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334959744 00000100:00100000:3.0:1780809582.142698:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334959744 00000100:00100000:3.0:1780809582.142751:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7459 00000100:00080000:2.0:1780809582.142761:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809582.142770:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:142231:x1867312334959744:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809582.142789:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809582.142804:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f33bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872101 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.142855:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.142865:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.142873:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.142882:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.142887:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.142890:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143157:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f33d0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143167:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f33d0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143172:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f33d0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809582.143187:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809582.143251:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143257:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143261:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143264:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.143267:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143271:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143279:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809582.143281:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.143285:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143288:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143295:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143298:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143308:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143311:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.143313:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143316:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143320:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809582.143321:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.143323:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143326:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143353:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f33bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872101 expref: 26 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143362:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f33d0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872101 expref: 25 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.143367:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809582.143368:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809582.143370:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809582.143412:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142231:x1867312334959744:12345-192.168.203.33@tcp:101:dd.0 Request processed in 645us (794us total) trans 55834578558 rc 0/0 00000100:00100000:3.0:1780809582.143423:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7459 00000100:00100000:3.0:1780809582.144382:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.144404:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809582.144426:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334959872 00000100:00100000:2.0:1780809582.144432:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334959872 00000100:00100000:1.0:1780809582.144439:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334960128 00000100:00100000:1.0:1780809582.144444:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334960128 00000100:00100000:2.0:1780809582.144482:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2124 00000100:00100000:1.0:1780809582.144482:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1765 00000100:00100000:1.0:1780809582.144489:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:142231:x1867312334960128:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809582.144498:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2393:x1867312334959872:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809582.144509:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809582.144523:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f33d0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872101 expref: 26 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.144537:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809582.144541:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809582.144576:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2393:x1867312334959872:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809582.144584:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:142231:x1867312334960128:12345-192.168.203.33@tcp:35:dd.0 Request processed in 95us (177us total) trans 55834578559 rc 0/0 00000100:00100000:2.0:1780809582.144611:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2124 00000100:00100000:1.0:1780809582.144628:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1765 00000100:00100000:0.0:1780809582.259839:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.259906:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334960384 00000100:00100000:3.0:1780809582.259915:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334960384 00000100:00100000:3.0:1780809582.259956:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1766 00000100:00100000:3.0:1780809582.259965:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142221:x1867312334960384:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809582.260184:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:142221:x1867312334960384:12345-192.168.203.33@tcp:35:dd.0 Request processed in 221us (353us total) trans 55834578560 rc 0/0 00000100:00100000:3.0:1780809582.260190:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1766 00000100:00100000:0.0:1780809582.396389:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.396441:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334960640 00000100:00100000:3.0:1780809582.396449:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334960640 00000100:00100000:3.0:1780809582.396493:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7460 00000100:00100000:3.0:1780809582.396500:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:142244:x1867312334960640:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809582.396520:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809582.396535:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f33de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872108 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396584:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396619:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396626:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396648:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396652:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396656:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396915:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f33f3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396921:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f33f3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.396925:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f33f3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809582.396932:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809582.397013:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397018:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397023:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397026:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.397029:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397041:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397049:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809582.397051:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.397054:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397058:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f33e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397066:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397070:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397073:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397076:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.397077:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397080:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397084:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809582.397085:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.397087:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397095:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f33ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397137:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f33de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872108 expref: 29 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397152:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f33f3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872108 expref: 28 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.397159:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809582.397160:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809582.397162:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809582.397206:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:142244:x1867312334960640:12345-192.168.203.33@tcp:101:dd.0 Request processed in 707us (823us total) trans 55834578561 rc 0/0 00000100:00100000:3.0:1780809582.397210:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7460 00000100:00100000:0.0:1780809582.398158:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.398262:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334960768 00000100:00100000:1.0:1780809582.398268:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334960768 00000100:00100000:1.0:1780809582.398302:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2125 00000100:00100000:1.0:1780809582.398310:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2391:x1867312334960768:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809582.398321:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809582.398335:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f33f3 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872108 expref: 28 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.398349:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.398352:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809582.398382:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2391:x1867312334960768:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809582.398400:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2125 00000100:00100000:0.0:1780809582.399031:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.399065:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334960896 00000100:00100000:3.0:1780809582.399070:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334960896 00000100:00100000:3.0:1780809582.399109:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7461 00000100:00100000:3.0:1780809582.399117:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:142245:x1867312334960896:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809582.399130:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809582.399143:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687210f expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399188:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399199:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399210:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399219:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399223:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399227:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399430:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399441:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 28 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399449:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399476:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 28 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.399487:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 28 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809582.399500:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338742144:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809582.399551:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf723b000 going to sleep for 11 seconds 00000100:00100000:3.0:1780809582.400213:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338742144:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809582.400229:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809582.400354:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.400391:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334961152 00000100:00100000:1.0:1780809582.400395:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334961152 00000100:00100000:1.0:1780809582.400423:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1767 00000100:00100000:1.0:1780809582.400429:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:89646:x1867312334961152:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809582.400544:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:89646:x1867312334961152:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 115us (190us total) trans 55834578562 rc 0/0 00000100:00100000:1.0:1780809582.400549:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1767 00000100:00100000:0.0:1780809582.401216:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.401244:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334961280 00000100:00100000:1.0:1780809582.401248:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334961280 00010000:00010000:1.0:1780809582.401261:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 30 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.401280:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 533 00000100:00100000:1.0:1780809582.401284:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2394:x1867312334961280:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809582.401290:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809582.401294:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 30 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.401302:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 30 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.401313:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f33ad lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468720fa expref: 30 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.401330:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.401337:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.401343:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.401347:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.401360:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809582.401377:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.401379:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2394:x1867312334961280:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 94us (163us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809582.401393:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.401394:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 533 00000004:00200000:3.0:1780809582.401417:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809582.401427:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809582.401437:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401445:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401451:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401456:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401460:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401463:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.401465:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401470:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401489:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809582.401492:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.401496:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401502:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401513:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401520:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401532:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401537:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.401539:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401542:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401548:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91000) 00010000:00010000:3.0:1780809582.401549:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.401551:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401555:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f340f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401582:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 29 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401606:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 28 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.401612:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809582.401614:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809582.401617:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030400, rc 0) 00000100:00100000:3.0:1780809582.401651:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:142245:x1867312334960896:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2534us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809582.401659:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7461 00000100:00100000:0.0:1780809582.403539:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.403572:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334961536 00000100:00100000:1.0:1780809582.403578:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334961536 00000100:00100000:1.0:1780809582.403640:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7462 00000100:00100000:1.0:1780809582.403651:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:142245:x1867312334961536:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809582.403665:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809582.403676:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f341d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872116 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.403725:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.403735:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 29 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.403743:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.403777:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 29 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.403790:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 29 pid: 78216 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.403802:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338742272:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809582.403849:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd1316300 going to sleep for 11 seconds 00000100:00100000:1.0:1780809582.404557:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338742272:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809582.404578:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809582.404754:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809582.404797:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334961664 00000100:00100000:2.0:1780809582.404801:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334961664 00010000:00010000:2.0:1780809582.404819:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 30 pid: 78216 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809582.404840:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 534 00000100:00100000:2.0:1780809582.404847:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2393:x1867312334961664:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809582.404854:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809582.404858:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 30 pid: 78216 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.404875:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 30 pid: 78216 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.404887:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3416 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687210f expref: 30 pid: 78216 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.404897:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809582.404901:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.404910:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.404923:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.404942:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809582.404962:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.404971:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809582.404974:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2393:x1867312334961664:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 126us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809582.404996:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 534 00000004:00200000:1.0:1780809582.405001:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809582.405097:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f341d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 30 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.405110:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 29 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.405117:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.405120:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809582.405130:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:1.0:1780809582.405162:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:142245:x1867312334961536:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1513us (1625us total) trans 55834578563 rc 0/0 00000100:00100000:1.0:1780809582.405169:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7462 00000100:00100000:0.0:1780809582.533802:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.533851:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334961792 00000100:00100000:1.0:1780809582.533859:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334961792 00000100:00100000:1.0:1780809582.533901:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7463 00000100:00100000:1.0:1780809582.533908:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:142252:x1867312334961792:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809582.533929:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809582.533946:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3432 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687211d expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534011:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534022:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534031:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534039:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534044:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534048:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534269:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534282:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 30 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534288:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534311:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 30 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.534320:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 30 pid: 80225 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.534331:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338742400:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809582.534386:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd1316c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780809582.535089:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338742400:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809582.535101:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809582.535246:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.535288:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334962048 00000100:00100000:3.0:1780809582.535293:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334962048 00000100:00100000:3.0:1780809582.535317:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1768 00000100:00100000:3.0:1780809582.535323:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:90168:x1867312334962048:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809582.535448:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:90168:x1867312334962048:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 125us (204us total) trans 55834578564 rc 0/0 00000100:00100000:3.0:1780809582.535454:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1768 00000100:00100000:0.0:1780809582.536059:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.536098:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334962176 00000100:00100000:1.0:1780809582.536102:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334962176 00010000:00010000:1.0:1780809582.536116:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 32 pid: 80225 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.536134:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 535 00000100:00100000:1.0:1780809582.536139:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:2394:x1867312334962176:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809582.536146:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809582.536159:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 32 pid: 80225 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.536172:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 32 pid: 80225 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.536187:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3424 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872116 expref: 32 pid: 80225 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.536210:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.536215:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.536222:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.536227:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.536247:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809582.536272:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.536280:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2394:x1867312334962176:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 138us (221us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809582.536288:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.536289:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 535 00000004:00200000:0.0:1780809582.536317:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809582.536321:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809582.536335:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536345:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536364:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536370:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536414:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536421:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809582.536426:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536432:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536441:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809582.536444:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809582.536447:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536453:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536462:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536468:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536473:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536483:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809582.536486:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536492:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536499:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479ff00) 00010000:00010000:0.0:1780809582.536501:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809582.536504:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536509:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3440 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536535:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3432 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 31 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536546:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 30 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809582.536553:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809582.536556:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809582.536558:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64c00, rc 0) 00000100:00100000:0.0:1780809582.536620:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:142252:x1867312334961792:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2680us (2795us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809582.536628:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7463 00000100:00100000:0.0:1780809582.537809:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809582.537856:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334962432 00000100:00100000:2.0:1780809582.537860:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334962432 00000100:00100000:2.0:1780809582.537891:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7464 00000100:00100000:2.0:1780809582.537898:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:142252:x1867312334962432:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809582.537912:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809582.537924:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f344e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872124 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.537999:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.538007:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 31 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.538012:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.538028:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 31 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.538035:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 31 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809582.538043:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4370000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338742528:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809582.538079:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551d900 going to sleep for 11 seconds 00000100:00100000:1.0:1780809582.538697:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4370000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338742528:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809582.538708:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809582.538776:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.538808:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334962560 00000100:00100000:1.0:1780809582.538813:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334962560 00010000:00010000:1.0:1780809582.538835:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 32 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.538853:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 536 00000100:00100000:1.0:1780809582.538859:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:2393:x1867312334962560:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809582.538865:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809582.538869:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 32 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.538876:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 32 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.538885:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3447 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687211d expref: 32 pid: 77627 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.538892:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.538895:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.538900:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.538903:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.538918:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809582.538939:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.538948:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2393:x1867312334962560:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 86us (169us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809582.538950:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.538962:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 536 00000004:00200000:2.0:1780809582.538967:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809582.539050:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f344e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 32 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.539070:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 31 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809582.539084:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809582.539086:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809582.539089:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f800, rc 0) 00000100:00100000:2.0:1780809582.539128:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:142252:x1867312334962432:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1226us (1317us total) trans 55834578565 rc 0/0 00000100:00100000:2.0:1780809582.539135:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7464 00000100:00100000:0.0:1780809582.585457:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.585512:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334962816 00000100:00100000:3.0:1780809582.585520:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334962816 00000100:00100000:3.0:1780809582.585560:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7465 00000100:00100000:3.0:1780809582.585567:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:142259:x1867312334962816:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809582.585585:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809582.585616:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3463 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687212b expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.585680:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.585694:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.585737:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.585751:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.585759:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.585766:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586140:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3478 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586151:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3478 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586159:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3478 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809582.586169:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809582.586246:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586258:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586263:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586266:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.586269:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586274:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586282:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809582.586284:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.586287:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586290:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f346a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586299:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586302:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586306:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586308:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.586313:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586317:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586321:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91000) 00010000:00010000:3.0:1780809582.586322:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.586323:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586326:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3471 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586353:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3463 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687212b expref: 34 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586362:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3478 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687212b expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.586366:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809582.586367:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809582.586369:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809582.586411:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:142259:x1867312334962816:12345-192.168.203.33@tcp:101:dd.0 Request processed in 845us (960us total) trans 55834578566 rc 0/0 00000100:00100000:3.0:1780809582.586416:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7465 00000100:00100000:0.0:1780809582.587345:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809582.587364:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809582.587392:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334962944 00000100:00100000:2.0:1780809582.587397:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334962944 00000100:00100000:1.0:1780809582.587409:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334963200 00000100:00100000:1.0:1780809582.587416:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334963200 00000100:00100000:2.0:1780809582.587428:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2126 00000100:00100000:2.0:1780809582.587441:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadd095d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2394:x1867312334962944:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809582.587448:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780809582.587454:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1769 00010000:00010000:2.0:1780809582.587461:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3478 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687212b expref: 34 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.587469:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:142259:x1867312334963200:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809582.587473:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809582.587477:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809582.587505:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadd095d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2394:x1867312334962944:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809582.587509:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2126 00000100:00100000:1.0:1780809582.587615:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:142259:x1867312334963200:12345-192.168.203.33@tcp:35:dd.0 Request processed in 150us (246us total) trans 55834578567 rc 0/0 00000100:00100000:1.0:1780809582.587623:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1769 00000100:00100000:0.0:1780809582.667181:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.667237:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334963328 00000100:00100000:3.0:1780809582.667246:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334963328 00000100:00100000:3.0:1780809582.667288:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7466 00000100:00100000:3.0:1780809582.667296:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:142266:x1867312334963328:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809582.667324:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809582.667339:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872132 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667386:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667396:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667403:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667412:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667416:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667420:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667701:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667713:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 34 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667719:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667742:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 34 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.667764:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 34 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809582.667777:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338742656:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809582.667844:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded119000 going to sleep for 11 seconds 00000100:00100000:3.0:1780809582.668582:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338742656:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809582.668606:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809582.668717:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.668757:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334963584 00000100:00100000:3.0:1780809582.668763:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334963584 00000100:00100000:3.0:1780809582.668795:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1770 00000100:00100000:3.0:1780809582.668802:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:90168:x1867312334963584:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809582.668958:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:90168:x1867312334963584:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 155us (240us total) trans 55834578568 rc 0/0 00000100:00100000:3.0:1780809582.668967:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1770 00000100:00100000:0.0:1780809582.669575:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.669627:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334963712 00000100:00100000:1.0:1780809582.669631:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334963712 00010000:00010000:1.0:1780809582.669648:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 36 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.669667:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 537 00000100:00100000:1.0:1780809582.669672:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2393:x1867312334963712:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809582.669678:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809582.669682:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 36 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.669692:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 36 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.669705:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3455 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872124 expref: 36 pid: 77628 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.669725:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.669728:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.669745:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.669749:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.669764:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809582.669784:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2393:x1867312334963712:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809582.669789:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 537 00010000:00010000:3.0:1780809582.669796:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669806:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809582.669831:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809582.669836:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809582.669849:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669870:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669879:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669886:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669894:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669900:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.669904:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669913:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669922:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809582.669925:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.669929:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669935:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f348d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669944:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669949:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669961:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669967:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809582.669970:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669976:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.669996:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91000) 00010000:00010000:3.0:1780809582.669998:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809582.670002:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.670008:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3494 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.670035:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 35 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.670048:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 34 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.670056:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809582.670058:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809582.670061:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809582.670090:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:142266:x1867312334963328:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2794us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809582.670106:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7466 00000100:00100000:0.0:1780809582.671439:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809582.671477:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334963968 00000100:00100000:3.0:1780809582.671483:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334963968 00000100:00100000:3.0:1780809582.671517:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7467 00000100:00100000:3.0:1780809582.671523:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:142266:x1867312334963968:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809582.671533:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809582.671541:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f34a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872139 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.671583:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.671609:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 35 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.671614:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.671629:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 35 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.671636:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 35 pid: 77629 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809582.671643:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338742784:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809582.671683:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9caded119000 going to sleep for 11 seconds 00000100:00100000:3.0:1780809582.672389:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338742784:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809582.672405:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809582.672498:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.672533:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334964096 00000100:00100000:1.0:1780809582.672537:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334964096 00010000:00010000:1.0:1780809582.672551:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 36 pid: 77629 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.672571:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 538 00000100:00100000:1.0:1780809582.672577:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2393:x1867312334964096:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809582.672583:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809582.672602:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 36 pid: 77629 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.672610:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 36 pid: 77629 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.672623:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f349b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872132 expref: 36 pid: 77629 timeout: 1944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.672639:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.672642:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.672647:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.672650:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.672666:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809582.672685:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.672693:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2393:x1867312334964096:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 113us (194us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809582.672695:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.672705:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 538 00000004:00200000:3.0:1780809582.672718:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809582.672789:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f34a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 36 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.672798:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 35 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809582.672803:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809582.672805:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809582.672807:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809582.672830:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:142266:x1867312334963968:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1308us (1393us total) trans 55834578569 rc 0/0 00000100:00100000:3.0:1780809582.672834:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7467 00000100:00100000:0.0:1780809582.707549:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.707634:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334964352 00000100:00100000:1.0:1780809582.707645:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334964352 00000100:00100000:1.0:1780809582.707694:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1771 00000100:00100000:1.0:1780809582.707705:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:142244:x1867312334964352:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809582.707932:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:142244:x1867312334964352:12345-192.168.203.33@tcp:35:dd.0 Request processed in 228us (386us total) trans 55834578570 rc 0/0 00000100:00100000:1.0:1780809582.707941:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1771 00000100:00100000:0.0:1780809582.936060:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.936110:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334964608 00000100:00100000:1.0:1780809582.936119:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334964608 00000100:00100000:1.0:1780809582.936171:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7468 00000100:00100000:1.0:1780809582.936179:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:142286:x1867312334964608:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809582.936198:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809582.936229:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f34b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872140 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936285:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936295:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936304:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936313:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936317:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936321:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936572:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f34cc lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936579:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f34cc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936583:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f34cc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809582.936613:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809582.936688:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936700:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936704:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936708:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809582.936711:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936715:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936723:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809582.936725:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809582.936728:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936732:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f34be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936739:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936743:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936746:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936749:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809582.936759:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936763:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936768:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809582.936769:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809582.936771:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936775:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f34c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936803:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f34b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872140 expref: 39 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936811:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f34cc lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872140 expref: 38 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.936815:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.936816:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809582.936818:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64600, rc 0) 00000100:00100000:1.0:1780809582.936859:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142286:x1867312334964608:12345-192.168.203.33@tcp:101:dd.0 Request processed in 682us (806us total) trans 55834578571 rc 0/0 00000100:00100000:1.0:1780809582.936865:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7468 00000100:00100000:0.0:1780809582.938013:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809582.938061:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334964736 00000100:00100000:2.0:1780809582.938065:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334964736 00000100:00100000:0.0:1780809582.938070:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809582.938107:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2127 00000100:00100000:1.0:1780809582.938110:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334964992 00000100:00100000:2.0:1780809582.938116:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2393:x1867312334964736:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809582.938117:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334964992 00010000:00010000:2.0:1780809582.938127:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809582.938144:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f34cc lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872140 expref: 39 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809582.938152:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7469 00010000:00010000:2.0:1780809582.938154:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809582.938159:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809582.938161:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142287:x1867312334964992:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809582.938178:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809582.938186:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f34da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872147 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809582.938191:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2393:x1867312334964736:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809582.938201:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2127 00010000:00010000:1.0:1780809582.938225:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938234:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938240:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938248:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938252:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938256:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938475:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f34ef lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938482:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f34ef lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938486:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f34ef lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809582.938491:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809582.938535:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938539:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938543:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938546:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809582.938549:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938553:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938558:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809582.938560:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809582.938562:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938565:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f34e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938572:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938575:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938579:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938605:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809582.938607:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938612:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938618:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:1.0:1780809582.938620:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809582.938622:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938626:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f34e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938648:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f34da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872147 expref: 40 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938655:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f34ef lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872147 expref: 39 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.938659:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.938661:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809582.938662:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64400, rc 0) 00000100:00100000:1.0:1780809582.938691:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142287:x1867312334964992:12345-192.168.203.33@tcp:101:dd.0 Request processed in 531us (622us total) trans 55834578572 rc 0/0 00000100:00100000:1.0:1780809582.938697:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7469 00000100:00100000:0.0:1780809582.939578:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809582.939618:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809582.939637:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334965120 00000100:00100000:1.0:1780809582.939646:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334965120 00000100:00100000:3.0:1780809582.939666:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334965376 00000100:00100000:3.0:1780809582.939672:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334965376 00000100:00100000:1.0:1780809582.939681:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2128 00000100:00100000:1.0:1780809582.939692:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2392:x1867312334965120:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809582.939700:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1772 00010000:00010000:1.0:1780809582.939709:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809582.939710:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:142287:x1867312334965376:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809582.939728:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f34ef lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872147 expref: 40 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809582.939742:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809582.939746:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809582.939773:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2392:x1867312334965120:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809582.939778:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2128 00000100:00100000:3.0:1780809582.939827:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142287:x1867312334965376:12345-192.168.203.33@tcp:35:dd.0 Request processed in 119us (207us total) trans 55834578573 rc 0/0 00000100:00100000:3.0:1780809582.939839:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1772 00000100:00100000:0.0:1780809583.001911:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809583.002014:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334965504 00000100:00100000:2.0:1780809583.002024:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334965504 00000100:00100000:2.0:1780809583.002070:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7470 00000100:00100000:2.0:1780809583.002077:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142294:x1867312334965504:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809583.002098:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809583.002115:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f34fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687214e expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002172:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002183:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002191:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002200:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002204:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002221:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002485:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002493:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 40 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002499:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002522:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 40 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.002531:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 40 pid: 78216 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809583.002541:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338742912:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809583.002625:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551de40 going to sleep for 11 seconds 00000100:00100000:2.0:1780809583.003335:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338742912:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809583.003348:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809583.003484:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.003519:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334965760 00000100:00100000:1.0:1780809583.003524:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334965760 00000100:00100000:1.0:1780809583.003550:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1773 00000100:00100000:1.0:1780809583.003556:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:89646:x1867312334965760:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809583.003699:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:89646:x1867312334965760:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 143us (215us total) trans 55834578574 rc 0/0 00000100:00100000:1.0:1780809583.003705:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1773 00000100:00100000:0.0:1780809583.004342:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.004387:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334965888 00000100:00100000:1.0:1780809583.004391:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334965888 00010000:00010000:1.0:1780809583.004405:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 42 pid: 78216 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809583.004424:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 539 00000100:00100000:1.0:1780809583.004429:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2394:x1867312334965888:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809583.004444:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809583.004449:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 42 pid: 78216 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.004457:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 42 pid: 78216 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.004469:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f34a9 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872139 expref: 42 pid: 78216 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.004479:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.004483:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.004488:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.004492:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.004506:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809583.004527:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2394:x1867312334965888:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 98us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809583.004533:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 539 00010000:00010000:2.0:1780809583.004535:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004545:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809583.004578:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809583.004583:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809583.004625:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004637:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004646:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004652:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004659:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004664:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809583.004669:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004677:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004691:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809583.004694:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809583.004698:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004705:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004737:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004744:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004749:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004755:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809583.004758:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004763:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004770:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809583.004773:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809583.004776:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004782:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f350b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004819:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f34fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 41 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004832:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 40 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.004849:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809583.004852:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809583.004854:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ea00, rc 0) 00000100:00100000:2.0:1780809583.004886:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:142294:x1867312334965504:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2809us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809583.004893:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7470 00000100:00100000:0.0:1780809583.006416:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.006459:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334966144 00000100:00100000:3.0:1780809583.006465:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334966144 00000100:00100000:3.0:1780809583.006494:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7471 00000100:00100000:3.0:1780809583.006500:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:142294:x1867312334966144:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809583.006513:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809583.006523:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872155 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.006570:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.006579:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 41 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.006584:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.006629:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 41 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.006641:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 41 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809583.006653:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338743040:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809583.006710:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd037ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1780809583.007391:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338743040:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809583.007420:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809583.007551:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809583.007581:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334966272 00000100:00100000:2.0:1780809583.007585:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334966272 00010000:00010000:2.0:1780809583.007612:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 42 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809583.007630:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 540 00000100:00100000:2.0:1780809583.007634:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2393:x1867312334966272:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809583.007640:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809583.007644:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 42 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.007652:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 42 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.007664:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3512 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687214e expref: 42 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.007680:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809583.007683:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.007693:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.007698:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.007718:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809583.007745:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809583.007751:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2393:x1867312334966272:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 113us (198us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809583.007754:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809583.007765:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 540 00000004:00200000:3.0:1780809583.007769:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809583.007851:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 42 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.007861:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 41 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.007866:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809583.007868:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809583.007870:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809583.007892:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142294:x1867312334966144:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1393us (1479us total) trans 55834578575 rc 0/0 00000100:00100000:3.0:1780809583.007897:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7471 00000100:00100000:0.0:1780809583.086231:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.086289:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334966528 00000100:00100000:3.0:1780809583.086298:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334966528 00000100:00100000:3.0:1780809583.086341:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7472 00000100:00100000:3.0:1780809583.086353:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142301:x1867312334966528:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809583.086375:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809583.086389:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f352e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687215c expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086454:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086465:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086472:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086482:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086486:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086490:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086808:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3543 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086816:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3543 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086820:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3543 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809583.086827:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809583.086888:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086904:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086910:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086915:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.086919:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086926:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086937:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809583.086940:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.086945:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086950:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086962:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086968:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086972:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086975:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.086995:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.086999:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.087005:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91000) 00010000:00010000:3.0:1780809583.087006:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.087008:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.087012:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f353c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.087041:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f352e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687215c expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.087049:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3543 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687215c expref: 43 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.087053:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809583.087055:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809583.087056:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809583.087104:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142301:x1867312334966528:12345-192.168.203.33@tcp:101:dd.0 Request processed in 756us (882us total) trans 55834578576 rc 0/0 00000100:00100000:3.0:1780809583.087109:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7472 00000100:00100000:0.0:1780809583.088124:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.088166:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334966656 00000100:00100000:1.0:1780809583.088180:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334966656 00000100:00100000:1.0:1780809583.088224:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2129 00000100:00100000:1.0:1780809583.088233:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadd095c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2392:x1867312334966656:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1780809583.088249:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:1.0:1780809583.088251:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809583.088265:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3543 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687215c expref: 43 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.088276:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00000100:00100000:3.0:1780809583.088279:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334966912 00010000:00010000:1.0:1780809583.088279:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809583.088285:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334966912 00000100:00100000:1.0:1780809583.088306:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadd095c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2392:x1867312334966656:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809583.088311:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2129 00000100:00100000:3.0:1780809583.088325:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1774 00000100:00100000:3.0:1780809583.088335:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:142301:x1867312334966912:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809583.088461:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142301:x1867312334966912:12345-192.168.203.33@tcp:35:dd.0 Request processed in 127us (212us total) trans 55834578577 rc 0/0 00000100:00100000:3.0:1780809583.088468:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1774 00010000:00010000:0.0:1780809583.155709:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809583.242334:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.242395:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334967168 00000100:00100000:1.0:1780809583.242405:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334967168 00000100:00100000:1.0:1780809583.242458:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1775 00000100:00100000:1.0:1780809583.242476:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142286:x1867312334967168:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809583.242732:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142286:x1867312334967168:12345-192.168.203.33@tcp:35:dd.0 Request processed in 259us (405us total) trans 55834578578 rc 0/0 00000100:00100000:1.0:1780809583.242740:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1775 00000100:00100000:0.0:1780809583.431353:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.431418:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334967424 00000100:00100000:3.0:1780809583.431428:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334967424 00000100:00100000:3.0:1780809583.431473:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7473 00000100:00100000:3.0:1780809583.431481:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142309:x1867312334967424:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809583.431503:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809583.431523:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872163 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431582:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431621:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431629:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431638:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431642:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431646:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431911:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3566 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431922:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3566 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.431927:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3566 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809583.431935:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809583.432012:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432018:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432022:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432026:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.432029:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432034:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432042:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809583.432044:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.432047:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432051:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432066:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432070:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432073:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432076:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.432077:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432080:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432084:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91000) 00010000:00010000:3.0:1780809583.432085:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.432087:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432090:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f355f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432119:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872163 expref: 47 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432131:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3566 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872163 expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.432148:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809583.432150:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809583.432153:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809583.432199:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:142309:x1867312334967424:12345-192.168.203.33@tcp:101:dd.0 Request processed in 719us (853us total) trans 55834578579 rc 0/0 00000100:00100000:3.0:1780809583.432205:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7473 00000100:00100000:0.0:1780809583.435701:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.435746:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334967552 00000100:00100000:1.0:1780809583.435753:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334967552 00000100:00100000:1.0:1780809583.435791:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2130 00000100:00100000:1.0:1780809583.435796:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2394:x1867312334967552:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809583.435806:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809583.435827:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3566 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872163 expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.435840:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.435850:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809583.435881:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2394:x1867312334967552:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 85us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809583.435887:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2130 00000100:00100000:0.0:1780809583.469254:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.469304:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334967808 00000100:00100000:1.0:1780809583.469311:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334967808 00000100:00100000:1.0:1780809583.469352:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7474 00000100:00100000:1.0:1780809583.469359:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:142315:x1867312334967808:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809583.469378:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809583.469394:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687216a expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469447:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469457:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469464:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469473:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469477:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469481:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469762:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3589 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469778:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3589 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469785:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3589 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809583.469796:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809583.469862:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469867:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469871:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469875:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809583.469878:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469883:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469890:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809583.469892:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809583.469895:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469899:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f357b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469913:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469917:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469920:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469923:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809583.469924:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469928:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469931:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:1.0:1780809583.469932:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809583.469934:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469937:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3582 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469964:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687216a expref: 48 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469972:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3589 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687216a expref: 47 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.469996:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.469997:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809583.469999:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64a00, rc 0) 00000100:00100000:1.0:1780809583.470043:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142315:x1867312334967808:12345-192.168.203.33@tcp:101:dd.0 Request processed in 684us (795us total) trans 55834578580 rc 0/0 00000100:00100000:1.0:1780809583.470049:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7474 00000100:00100000:0.0:1780809583.470951:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809583.470986:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.471020:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334968192 00000100:00100000:3.0:1780809583.471025:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334968192 00000100:00100000:2.0:1780809583.471051:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334967936 00000100:00100000:3.0:1780809583.471056:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1776 00000100:00100000:2.0:1780809583.471058:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334967936 00000100:00100000:3.0:1780809583.471063:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:142315:x1867312334968192:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809583.471103:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2131 00000100:00100000:2.0:1780809583.471114:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2392:x1867312334967936:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809583.471124:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809583.471138:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3589 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687216a expref: 49 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.471152:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809583.471156:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809583.471173:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:142315:x1867312334968192:12345-192.168.203.33@tcp:35:dd.0 Request processed in 110us (185us total) trans 55834578581 rc 0/0 00000100:00100000:3.0:1780809583.471180:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1776 00000100:00100000:2.0:1780809583.471197:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2392:x1867312334967936:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809583.471205:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2131 00000100:00100000:0.0:1780809583.475748:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780809583.475767:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338743168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780809583.475831:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809583.475880:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338743168 00000100:00100000:0.0:1780809583.475886:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338743168 00000100:00100000:0.0:1780809583.475925:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1780809583.475933:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338743168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780809583.475966:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1780809583.476148:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338743168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 216us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809583.476154:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1780809583.476181:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338743168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780809583.619621:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.619676:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334968448 00000100:00100000:1.0:1780809583.619685:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334968448 00000100:00100000:1.0:1780809583.619729:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7475 00000100:00100000:1.0:1780809583.619736:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142322:x1867312334968448:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809583.619754:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809583.619770:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872171 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.619829:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.619840:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.619848:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.619857:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.619861:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.619876:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620146:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f35ac lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620156:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f35ac lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620164:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f35ac lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809583.620173:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809583.620237:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620242:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620246:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620249:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809583.620252:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620256:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620264:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809583.620267:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809583.620275:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620279:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f359e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620288:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620292:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620296:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620298:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809583.620300:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620303:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620307:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:1.0:1780809583.620308:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809583.620310:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620312:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f35a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620339:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872171 expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620356:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f35ac lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872171 expref: 49 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.620361:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.620362:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809583.620364:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64800, rc 0) 00000100:00100000:1.0:1780809583.620409:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142322:x1867312334968448:12345-192.168.203.33@tcp:101:dd.0 Request processed in 674us (797us total) trans 55834578582 rc 0/0 00000100:00100000:1.0:1780809583.620413:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7475 00000100:00100000:0.0:1780809583.621488:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809583.621508:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.621519:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334968576 00000100:00100000:1.0:1780809583.621525:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334968576 00000100:00100000:1.0:1780809583.621565:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2132 00000100:00100000:2.0:1780809583.621571:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334968832 00000100:00100000:1.0:1780809583.621575:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2393:x1867312334968576:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1780809583.621578:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334968832 00010000:00010000:1.0:1780809583.621584:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809583.621620:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f35ac lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872171 expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.621634:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.621638:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809583.621651:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1777 00000100:00100000:2.0:1780809583.621662:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142322:x1867312334968832:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809583.621675:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2393:x1867312334968576:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 101us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809583.621683:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2132 00000100:00100000:2.0:1780809583.621787:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142322:x1867312334968832:12345-192.168.203.33@tcp:35:dd.0 Request processed in 127us (276us total) trans 55834578583 rc 0/0 00000100:00100000:2.0:1780809583.621795:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1777 00000100:00100000:0.0:1780809583.731509:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.731615:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334969088 00000100:00100000:3.0:1780809583.731625:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334969088 00000100:00100000:3.0:1780809583.731667:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1778 00000100:00100000:3.0:1780809583.731675:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142309:x1867312334969088:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809583.731857:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142309:x1867312334969088:12345-192.168.203.33@tcp:35:dd.0 Request processed in 183us (354us total) trans 55834578584 rc 0/0 00000100:00100000:3.0:1780809583.731862:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1778 00000100:00100000:0.0:1780809583.736188:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809583.736246:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334969216 00000100:00100000:2.0:1780809583.736254:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334969216 00000100:00100000:2.0:1780809583.736299:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7476 00000100:00100000:2.0:1780809583.736307:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142329:x1867312334969216:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809583.736322:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809583.736338:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f35ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872178 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736381:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736391:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736399:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736407:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736411:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736415:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736670:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736678:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 51 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736684:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736707:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 51 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.736716:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 51 pid: 79214 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809583.736725:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338743296:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809583.736778:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1780809583.737531:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338743296:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809583.737545:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:2.0:1780809583.737546:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809583.737607:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334969472 00000100:00100000:1.0:1780809583.737612:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334969472 00000100:00100000:1.0:1780809583.737641:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1779 00000100:00100000:1.0:1780809583.737652:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:89645:x1867312334969472:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809583.737766:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:89645:x1867312334969472:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 115us (223us total) trans 55834578585 rc 0/0 00000100:00100000:1.0:1780809583.737772:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1779 00000100:00100000:0.0:1780809583.738447:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.738484:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334969600 00000100:00100000:1.0:1780809583.738488:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334969600 00010000:00010000:1.0:1780809583.738503:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 53 pid: 79214 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809583.738522:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 541 00000100:00100000:1.0:1780809583.738527:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2394:x1867312334969600:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809583.738534:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809583.738539:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 53 pid: 79214 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.738548:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 53 pid: 79214 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.738560:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3520 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872155 expref: 53 pid: 79214 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.738570:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.738573:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.738579:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.738615:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.738633:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809583.738656:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2394:x1867312334969600:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 128us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809583.738661:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 541 00010000:00010000:3.0:1780809583.738682:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738692:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809583.738728:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809583.738733:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809583.738746:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738758:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738767:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738774:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738780:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738787:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.738791:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738799:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738808:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809583.738811:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.738815:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738821:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f35c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738856:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738863:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738869:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738874:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.738877:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738884:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738892:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:3.0:1780809583.738894:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.738897:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738903:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f35c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738931:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f35ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 52 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738963:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 51 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.738999:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809583.739002:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809583.739005:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:3.0:1780809583.739038:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:142329:x1867312334969216:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2731us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809583.739045:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7476 00000100:00100000:0.0:1780809583.740827:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.740861:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334969856 00000100:00100000:3.0:1780809583.740866:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334969856 00000100:00100000:3.0:1780809583.740896:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7477 00000100:00100000:3.0:1780809583.740902:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:142329:x1867312334969856:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809583.740913:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809583.740922:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f35d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687217f expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.740988:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.740996:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 52 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.741002:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.741021:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 52 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.741033:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 52 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809583.741051:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338743424:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809583.741096:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd037ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1780809583.741845:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338743424:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809583.741856:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809583.741966:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809583.742026:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334969984 00000100:00100000:2.0:1780809583.742031:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334969984 00010000:00010000:2.0:1780809583.742050:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 53 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809583.742073:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 542 00000100:00100000:2.0:1780809583.742086:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2393:x1867312334969984:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809583.742095:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809583.742101:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 53 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.742113:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 53 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.742126:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f35cf lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872178 expref: 53 pid: 77628 timeout: 1945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.742144:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809583.742148:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.742154:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.742160:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809583.742178:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809583.742191:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.742197:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809583.742205:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809583.742206:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2393:x1867312334969984:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 121us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809583.742221:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 542 00010000:00010000:3.0:1780809583.742288:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f35d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 53 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.742297:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 52 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.742302:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809583.742304:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809583.742306:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809583.742329:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142329:x1867312334969856:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1427us (1504us total) trans 55834578586 rc 0/0 00000100:00100000:3.0:1780809583.742334:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7477 00000100:00100000:0.0:1780809583.957076:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.957137:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334970240 00000100:00100000:3.0:1780809583.957155:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334970240 00000100:00100000:3.0:1780809583.957206:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7478 00000100:00100000:3.0:1780809583.957216:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142344:x1867312334970240:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809583.957235:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809583.957250:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f35eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872186 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957302:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957313:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957323:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957332:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957336:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957340:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957582:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3600 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957617:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3600 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957622:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3600 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809583.957634:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809583.957703:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957708:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957712:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957716:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.957719:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957723:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957731:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809583.957733:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.957737:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957740:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f35f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957748:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957751:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957761:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957764:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.957766:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957769:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957773:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809583.957774:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.957776:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957779:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f35f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957805:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f35eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872186 expref: 55 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957812:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3600 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872186 expref: 54 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.957817:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809583.957818:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809583.957820:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809583.957862:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:142344:x1867312334970240:12345-192.168.203.33@tcp:101:dd.0 Request processed in 649us (794us total) trans 55834578587 rc 0/0 00000100:00100000:3.0:1780809583.957877:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7478 00000100:00100000:0.0:1780809583.958925:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.958987:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334970368 00000100:00100000:1.0:1780809583.958993:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334970368 00000100:00100000:1.0:1780809583.959033:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2133 00000100:00100000:1.0:1780809583.959043:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2391:x1867312334970368:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809583.959055:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809583.959068:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3600 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872186 expref: 54 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809583.959081:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.959085:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809583.959114:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2391:x1867312334970368:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809583.959121:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2133 00000100:00100000:0.0:1780809583.967326:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809583.967369:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334970624 00000100:00100000:3.0:1780809583.967376:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334970624 00000100:00100000:3.0:1780809583.967419:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7479 00000100:00100000:3.0:1780809583.967427:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:142350:x1867312334970624:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809583.967444:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809583.967457:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f360e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687218d expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967516:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967527:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967534:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967542:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967546:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967551:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967884:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3623 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967903:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3623 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.967911:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3623 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809583.967921:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809583.968019:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968027:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968033:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968039:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.968043:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968051:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968061:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809583.968064:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.968068:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968075:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968096:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968102:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968108:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968114:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809583.968117:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968124:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968131:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809583.968134:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809583.968137:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968143:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f361c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968177:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f360e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687218d expref: 56 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968190:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3623 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687218d expref: 55 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809583.968208:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809583.968211:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809583.968213:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809583.968257:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142350:x1867312334970624:12345-192.168.203.33@tcp:101:dd.0 Request processed in 830us (935us total) trans 55834578588 rc 0/0 00000100:00100000:3.0:1780809583.968265:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7479 00000100:00100000:0.0:1780809583.969129:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809583.969165:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809583.969171:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334970752 00000100:00100000:1.0:1780809583.969176:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334970752 00000100:00100000:3.0:1780809583.969199:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334971008 00000100:00100000:3.0:1780809583.969205:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334971008 00000100:00100000:1.0:1780809583.969207:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2134 00000100:00100000:1.0:1780809583.969215:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadd095e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2394:x1867312334970752:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809583.969223:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809583.969235:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3623 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687218d expref: 56 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809583.969240:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1780 00000100:00100000:3.0:1780809583.969250:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142350:x1867312334971008:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809583.969258:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809583.969262:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809583.969289:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadd095e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2394:x1867312334970752:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809583.969295:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2134 00000100:00100000:3.0:1780809583.969356:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142350:x1867312334971008:12345-192.168.203.33@tcp:35:dd.0 Request processed in 108us (190us total) trans 55834578589 rc 0/0 00000100:00100000:3.0:1780809583.969361:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1780 00010000:00010000:1.0:1780809584.179722:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809584.212151:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.212219:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334971264 00000100:00100000:1.0:1780809584.212229:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334971264 00000100:00080000:2.0:1780809584.212287:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780809584.212299:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7480 00000100:00100000:1.0:1780809584.212311:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142357:x1867312334971264:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809584.212333:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809584.212352:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872194 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212427:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212443:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212454:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212468:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212475:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212493:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212831:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3646 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212841:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3646 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212849:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3646 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809584.212859:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809584.212941:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212949:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212957:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212963:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809584.212967:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.212990:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213002:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809584.213005:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809584.213016:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213023:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213035:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213042:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213048:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213054:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809584.213057:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213063:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213069:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:1.0:1780809584.213072:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809584.213074:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213080:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f363f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213114:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872194 expref: 58 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213140:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3646 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872194 expref: 57 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.213147:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809584.213150:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809584.213152:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64000, rc 0) 00000100:00100000:1.0:1780809584.213204:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142357:x1867312334971264:12345-192.168.203.33@tcp:101:dd.0 Request processed in 896us (1060us total) trans 55834578590 rc 0/0 00000100:00100000:1.0:1780809584.213211:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7480 00000100:00100000:2.0:1780809584.214141:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809584.214177:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809584.214178:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334971392 00000100:00100000:0.0:1780809584.214182:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334971392 00000100:00100000:0.0:1780809584.214217:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2135 00000100:00100000:1.0:1780809584.214218:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334971648 00000100:00100000:1.0:1780809584.214224:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334971648 00000100:00100000:0.0:1780809584.214226:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312334971392:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809584.214235:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809584.214247:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3646 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872194 expref: 58 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.214257:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809584.214260:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809584.214265:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1781 00000100:00100000:1.0:1780809584.214275:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142357:x1867312334971648:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809584.214287:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312334971392:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 62us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809584.214292:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2135 00000100:00100000:1.0:1780809584.214384:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142357:x1867312334971648:12345-192.168.203.33@tcp:35:dd.0 Request processed in 110us (207us total) trans 55834578591 rc 0/0 00000100:00100000:1.0:1780809584.214392:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1781 00000100:00100000:2.0:1780809584.245073:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809584.245137:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334971904 00000100:00100000:3.0:1780809584.245146:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334971904 00000100:00100000:3.0:1780809584.245189:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1782 00000100:00100000:3.0:1780809584.245197:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142344:x1867312334971904:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809584.245372:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:142344:x1867312334971904:12345-192.168.203.33@tcp:35:dd.0 Request processed in 175us (307us total) trans 55834578592 rc 0/0 00000100:00100000:3.0:1780809584.245377:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1782 00000100:00100000:0.0:1780809584.265699:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.265752:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334972032 00000100:00100000:1.0:1780809584.265760:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334972032 00000100:00100000:1.0:1780809584.265797:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7481 00000100:00100000:1.0:1780809584.265805:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:142365:x1867312334972032:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809584.265823:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809584.265837:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687219b expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.265882:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.265903:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.265910:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.265919:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.265923:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.265927:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.266157:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.266165:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 59 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.266170:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.266191:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 59 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.266200:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 59 pid: 79214 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809584.266216:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338743552:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809584.266272:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc57d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780809584.267037:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338743552:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809584.267052:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809584.267117:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.267152:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334972288 00000100:00100000:1.0:1780809584.267157:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334972288 00000100:00100000:1.0:1780809584.267188:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1783 00000100:00100000:1.0:1780809584.267197:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:89646:x1867312334972288:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809584.267357:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:89646:x1867312334972288:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 159us (238us total) trans 55834578593 rc 0/0 00000100:00100000:1.0:1780809584.267366:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1783 00000100:00100000:0.0:1780809584.267967:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.268015:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334972416 00000100:00100000:1.0:1780809584.268019:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334972416 00010000:00010000:1.0:1780809584.268033:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 61 pid: 79214 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809584.268051:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 543 00000100:00100000:1.0:1780809584.268056:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2394:x1867312334972416:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809584.268063:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809584.268067:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 61 pid: 79214 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.268084:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 61 pid: 79214 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.268096:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f35dd lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687217f expref: 61 pid: 79214 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.268104:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809584.268107:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.268112:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.268116:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.268130:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809584.268152:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809584.268153:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2394:x1867312334972416:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 97us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809584.268161:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 543 00010000:00010000:0.0:1780809584.268168:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809584.268188:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809584.268192:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809584.268201:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268209:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268224:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268229:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268233:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268237:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809584.268270:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268275:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268282:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809584.268283:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809584.268286:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268289:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f365b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268296:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268299:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268303:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268310:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809584.268313:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268316:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268320:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:0.0:1780809584.268321:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809584.268323:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268326:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268345:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 60 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268358:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 59 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809584.268363:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809584.268364:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809584.268366:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:0.0:1780809584.268388:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142365:x1867312334972032:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2585us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809584.268392:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7481 00000100:00100000:0.0:1780809584.269583:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809584.269643:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334972672 00000100:00100000:2.0:1780809584.269647:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334972672 00000100:00100000:2.0:1780809584.269674:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7482 00000100:00100000:2.0:1780809584.269686:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142365:x1867312334972672:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809584.269700:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809584.269709:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721a2 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809584.269752:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809584.269760:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 60 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809584.269765:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809584.269780:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 60 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809584.269787:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 60 pid: 77627 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809584.269794:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf5f63480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338743680:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809584.269827:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1780809584.270397:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf5f63480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338743680:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809584.270412:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809584.270514:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.270547:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334972800 00000100:00100000:1.0:1780809584.270552:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334972800 00010000:00010000:1.0:1780809584.270568:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 61 pid: 77627 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809584.270608:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 544 00000100:00100000:1.0:1780809584.270616:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2393:x1867312334972800:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809584.270632:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809584.270637:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 61 pid: 77627 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.270651:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 61 pid: 77627 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.270665:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3669 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687219b expref: 61 pid: 77627 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.270675:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809584.270679:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.270687:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.270693:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.270720:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809584.270737:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.270743:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809584.270749:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2393:x1867312334972800:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 132us (234us total) trans 0 rc 0/0 00000004:00200000:3.0:1780809584.270754:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:1.0:1780809584.270754:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 544 00010000:00010000:3.0:1780809584.270824:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 61 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.270837:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 60 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.270842:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809584.270844:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809584.270846:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:3.0:1780809584.270870:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:142365:x1867312334972672:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1186us (1288us total) trans 55834578594 rc 0/0 00000100:00100000:3.0:1780809584.270874:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7482 00000100:00100000:0.0:1780809584.373079:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809584.373142:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334973056 00000100:00100000:3.0:1780809584.373152:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334973056 00000100:00100000:3.0:1780809584.373198:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7483 00000100:00100000:3.0:1780809584.373205:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:142377:x1867312334973056:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809584.373225:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809584.373239:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721a9 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373307:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373319:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373326:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373335:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373339:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373343:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373647:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f369a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373657:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f369a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373665:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f369a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809584.373675:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809584.373743:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373755:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373759:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373763:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809584.373766:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373771:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373779:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809584.373781:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809584.373784:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373788:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f368c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373795:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373799:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373802:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373805:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809584.373809:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373813:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373817:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809584.373819:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809584.373820:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373823:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3693 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373851:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a9 expref: 63 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373860:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f369a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a9 expref: 62 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.373864:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809584.373865:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809584.373866:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809584.373914:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142377:x1867312334973056:12345-192.168.203.33@tcp:101:dd.0 Request processed in 709us (843us total) trans 55834578595 rc 0/0 00000100:00100000:3.0:1780809584.373919:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7483 00000100:00100000:2.0:1780809584.374926:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809584.374963:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334973184 00000100:00100000:0.0:1780809584.374977:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334973184 00000100:00100000:2.0:1780809584.375010:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809584.375017:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2136 00000100:00100000:0.0:1780809584.375026:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:2394:x1867312334973184:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809584.375047:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334973440 00000100:00100000:1.0:1780809584.375054:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334973440 00010000:00010000:0.0:1780809584.375069:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809584.375084:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f369a lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a9 expref: 63 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809584.375090:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7484 00010000:00010000:0.0:1780809584.375103:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00000100:00100000:1.0:1780809584.375105:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142378:x1867312334973440:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809584.375109:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809584.375130:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1780809584.375139:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:2394:x1867312334973184:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 114us (213us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809584.375141:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f36a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721b0 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809584.375151:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2136 00010000:00010000:1.0:1780809584.375187:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375203:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375211:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375224:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375231:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375238:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375442:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f36bd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375448:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f36bd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375453:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f36bd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809584.375458:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809584.375498:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375503:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375506:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375509:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809584.375512:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375516:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375521:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809584.375523:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809584.375525:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375528:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f36af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375534:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375537:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375541:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375552:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809584.375554:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375557:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375561:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809584.375562:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809584.375564:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375567:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f36b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375586:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f36a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721b0 expref: 64 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375614:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f36bd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721b0 expref: 63 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.375619:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809584.375621:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809584.375623:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64200, rc 0) 00000100:00100000:1.0:1780809584.375649:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142378:x1867312334973440:12345-192.168.203.33@tcp:101:dd.0 Request processed in 549us (641us total) trans 55834578596 rc 0/0 00000100:00100000:1.0:1780809584.375653:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7484 00000100:00100000:2.0:1780809584.376563:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809584.376605:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.376620:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334973568 00000100:00100000:3.0:1780809584.376630:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334973824 00000100:00100000:1.0:1780809584.376631:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334973568 00000100:00100000:3.0:1780809584.376635:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334973824 00000100:00100000:3.0:1780809584.376675:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1784 00000100:00100000:1.0:1780809584.376680:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2137 00000100:00100000:3.0:1780809584.376689:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142378:x1867312334973824:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809584.376692:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2392:x1867312334973568:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809584.376699:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809584.376709:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f36bd lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721b0 expref: 64 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.376716:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809584.376719:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809584.376742:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2392:x1867312334973568:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809584.376747:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2137 00000100:00100000:3.0:1780809584.376813:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142378:x1867312334973824:12345-192.168.203.33@tcp:35:dd.0 Request processed in 128us (223us total) trans 55834578597 rc 0/0 00000100:00100000:3.0:1780809584.376819:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1784 00000100:00100000:2.0:1780809584.499735:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf5f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338743808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780809584.499736:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338743936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780809584.499761:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780809584.499778:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfcec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338744064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809584.499796:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809584.499823:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809584.499831:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338744320:0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.499854:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338744192:0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.499861:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809584.499889:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc75fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338744832:0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.499893:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809584.499920:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809584.499938:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc75fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338744704:0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.499940:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744320 00000100:00100000:2.0:1780809584.499944:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1867312338745344:0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.499949:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744320 00000100:00100000:0.0:1780809584.499987:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809584.499997:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744832 00000100:00100000:2.0:1780809584.500001:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744832 00000100:00100000:3.0:1780809584.500014:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1780809584.500022:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3443:1867312338745216:0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500025:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338744320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.500029:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1780809584.500040:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338744832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500047:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809584.500091:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc75fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338744576:0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.500092:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338744832:12345-0@lo:400:kworker.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809584.500100:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338744320:12345-0@lo:400:kworker.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809584.500105:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1780809584.500120:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1780809584.500126:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809584.500144:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809584.500151:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc75ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1867312338745088:0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500153:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744704 00000100:00100000:3.0:1780809584.500157:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744704 00000100:00100000:2.0:1780809584.500170:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338744448:0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500185:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338745216 00000100:00100000:1.0:1780809584.500185:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809584.500188:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338745216 00000100:00100000:2.0:1780809584.500204:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809584.500207:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338743808 00000100:00080000:3.0:1780809584.500210:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780809584.500212:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338743808 00000100:00100000:3.0:1780809584.500223:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338745088 00000100:00100000:2.0:1780809584.500224:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc75fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3445:1867312338744960:0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500229:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338745088 00000100:00100000:1.0:1780809584.500232:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744192 00000100:00100000:1.0:1780809584.500235:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744192 00000100:00100000:2.0:1780809584.500247:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809584.500265:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744960 00000100:00100000:3.0:1780809584.500269:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744960 00000100:00100000:1.0:1780809584.500271:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1780809584.500276:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3445:1867312338745472:0@lo:400:kworker.0 00000100:00100000:1.0:1780809584.500282:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338744192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500286:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1780809584.500295:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338744704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.500301:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809584.500327:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338744192:12345-0@lo:400:kworker.0 Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809584.500334:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338744704:12345-0@lo:400:kworker.0 Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809584.500335:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1780809584.500342:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1780809584.500342:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338745472 00000100:00100000:2.0:1780809584.500347:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338745472 00000100:00100000:3.0:1780809584.500364:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1780809584.500374:0:82719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744064 00000100:00100000:3.0:1780809584.500375:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1867312338745088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809584.500378:0:82719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744064 00000100:00100000:2.0:1780809584.500383:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1780809584.500384:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338743936 00000100:00100000:0.0:1780809584.500390:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338743936 00000100:00100000:2.0:1780809584.500403:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3445:x1867312338744960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500412:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1867312338745088:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809584.500415:0:82719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1780809584.500425:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1780809584.500426:0:82719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338743808:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809584.500429:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1780809584.500436:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338744064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809584.500448:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1780809584.500452:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3445:x1867312338744960:12345-0@lo:400:kworker.0 Request processed in 52us (205us total) trans 0 rc 0/0 00002000:00000024:0.0:1780809584.500455:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00002000:00000024:1.0:1780809584.500459:0:82719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3566206976 avail 3564109824 00000100:00100000:3.0:1780809584.500460:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3445:x1867312338745472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.500465:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1780809584.500496:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338744064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809584.500501:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1780809584.500507:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3445:x1867312338745472:12345-0@lo:400:kworker.0 Request processed in 50us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809584.500507:0:82719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338743808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809584.500511:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc75fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3445:1867312338744960:0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500516:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1780809584.500522:0:82719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1780809584.500524:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1780809584.500526:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338743936:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1780809584.500529:0:3445:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadee4f6300 x1867312338745472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1780809584.500536:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809584.500537:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3445:1867312338745472:0@lo:400:kworker.0 00000100:00100000:1.0:1780809584.500549:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809584.500562:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc75ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1867312338745088:0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500577:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338743936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809584.500583:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1780809584.500605:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338743936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780809584.500607:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338744320:0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500618:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744576 00000100:00100000:0.0:1780809584.500622:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744576 00000100:00100000:2.0:1780809584.500630:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338745344 00000100:00100000:3.0:1780809584.500635:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1780809584.500635:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338745344 00000100:00100000:1.0:1780809584.500635:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf5f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338743808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809584.500647:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3443:x1867312338745216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500647:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338744448 00000100:00100000:0.0:1780809584.500652:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338744448 00000100:00100000:2.0:1780809584.500664:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1780809584.500669:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc75fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338744832:0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.500674:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1867312338745344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500685:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1780809584.500690:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3443:x1867312338745216:12345-0@lo:400:kworker.0 Request processed in 45us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809584.500696:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338744576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500701:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00010000:00080000:1.0:1780809584.500703:0:3443:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadee4f5880 x1867312338745216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780809584.500713:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3443:1867312338745216:0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.500717:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1867312338745344:12345-0@lo:400:kworker.0 Request processed in 45us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809584.500723:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1780809584.500731:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338744192:0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500737:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338744576:12345-0@lo:400:kworker.0 Request processed in 44us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809584.500743:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1780809584.500747:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc75fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338744704:0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.500756:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1867312338745344:0@lo:400:kworker.0 00000100:00100000:0.0:1780809584.500762:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1780809584.500770:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338744448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809584.500773:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfcec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338744064:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780809584.500776:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780809584.500780:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780809584.500784:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780809584.500787:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780809584.500804:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338744448:12345-0@lo:400:kworker.0 Request processed in 34us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809584.500817:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1780809584.500828:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338744448:0@lo:400:kworker.0 00000100:00100000:3.0:1780809584.500829:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc75fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338744576:0@lo:400:kworker.0 00000100:00100000:2.0:1780809584.636491:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.636543:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334974080 00000100:00100000:1.0:1780809584.636551:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334974080 00000100:00100000:1.0:1780809584.636608:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1785 00000100:00100000:1.0:1780809584.636617:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142377:x1867312334974080:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809584.636793:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142377:x1867312334974080:12345-192.168.203.33@tcp:35:dd.0 Request processed in 178us (310us total) trans 55834578598 rc 0/0 00000100:00100000:1.0:1780809584.636809:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1785 00000100:00100000:0.0:1780809584.719842:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809584.719904:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334974336 00000100:00100000:3.0:1780809584.719913:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334974336 00000100:00100000:3.0:1780809584.719955:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7485 00000100:00100000:3.0:1780809584.719962:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142386:x1867312334974336:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809584.719990:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809584.720005:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f36cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721b7 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720076:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720086:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720093:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720101:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720105:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720109:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720348:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f36e0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720357:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f36e0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720364:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f36e0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809584.720373:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809584.720448:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720460:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720464:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720467:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809584.720470:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720475:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720483:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809584.720484:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809584.720487:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720491:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720499:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720502:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720506:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720508:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809584.720513:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720517:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720521:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809584.720522:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809584.720524:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720527:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720553:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f36cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721b7 expref: 67 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720561:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f36e0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721b7 expref: 66 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.720565:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809584.720566:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809584.720568:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030400, rc 0) 00000100:00100000:3.0:1780809584.720643:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:142386:x1867312334974336:12345-192.168.203.33@tcp:101:dd.0 Request processed in 682us (811us total) trans 55834578599 rc 0/0 00000100:00100000:3.0:1780809584.720649:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7485 00000100:00100000:0.0:1780809584.721545:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809584.721608:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334974464 00000100:00100000:1.0:1780809584.721613:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334974464 00000100:00100000:1.0:1780809584.721642:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2138 00000100:00100000:1.0:1780809584.721648:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2393:x1867312334974464:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809584.721655:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809584.721677:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f36e0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721b7 expref: 66 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809584.721689:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809584.721693:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809584.721719:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312334974464:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809584.721725:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2138 00000100:00100000:0.0:1780809584.761061:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809584.761115:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334974720 00000100:00100000:3.0:1780809584.761125:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334974720 00000100:00100000:3.0:1780809584.761183:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7486 00000100:00100000:3.0:1780809584.761192:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:142392:x1867312334974720:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809584.761224:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809584.761243:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f36ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721be expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761303:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761313:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761321:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761330:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761334:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761339:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761646:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3703 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761656:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3703 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761664:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3703 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809584.761674:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809584.761763:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761772:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761779:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761785:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809584.761789:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761796:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761807:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809584.761810:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809584.761815:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761821:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f36f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761832:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761838:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761844:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761859:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809584.761862:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761869:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761876:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809584.761878:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809584.761881:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761887:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f36fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761922:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f36ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721be expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761937:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3703 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721be expref: 67 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809584.761945:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809584.761947:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809584.761950:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809584.762015:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142392:x1867312334974720:12345-192.168.203.33@tcp:101:dd.0 Request processed in 824us (959us total) trans 55834578600 rc 0/0 00000100:00100000:3.0:1780809584.762023:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7486 00000100:00100000:0.0:1780809584.762978:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809584.763010:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809584.763018:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334974848 00000100:00100000:2.0:1780809584.763024:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334974848 00000100:00100000:3.0:1780809584.763046:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334975104 00000100:00100000:3.0:1780809584.763057:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334975104 00000100:00100000:2.0:1780809584.763062:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2139 00000100:00100000:2.0:1780809584.763073:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadd095e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2392:x1867312334974848:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809584.763083:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809584.763098:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3703 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721be expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809584.763100:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1786 00000100:00100000:3.0:1780809584.763113:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142392:x1867312334975104:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809584.763120:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809584.763126:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809584.763155:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadd095e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:2392:x1867312334974848:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809584.763163:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2139 00000100:00100000:3.0:1780809584.763243:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142392:x1867312334975104:12345-192.168.203.33@tcp:35:dd.0 Request processed in 134us (231us total) trans 55834578601 rc 0/0 00000100:00100000:3.0:1780809584.763250:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1786 00000100:00100000:0.0:1780809585.009610:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809585.009674:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334975360 00000100:00100000:1.0:1780809585.009683:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334975360 00000100:00100000:1.0:1780809585.009729:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1787 00000100:00100000:1.0:1780809585.009739:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142386:x1867312334975360:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809585.009931:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142386:x1867312334975360:12345-192.168.203.33@tcp:35:dd.0 Request processed in 193us (346us total) trans 55834578602 rc 0/0 00000100:00100000:1.0:1780809585.009938:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1787 00000100:00100000:0.0:1780809585.010182:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809585.010232:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334975616 00000100:00100000:2.0:1780809585.010239:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334975616 00000100:00100000:2.0:1780809585.010273:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7487 00000100:00100000:2.0:1780809585.010280:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142406:x1867312334975616:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809585.010292:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809585.010310:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721c5 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010362:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010376:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010387:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010399:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010406:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010429:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010755:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3726 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010765:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3726 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010773:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3726 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809585.010783:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809585.010842:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010850:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010857:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010863:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809585.010868:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010876:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010887:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809585.010890:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809585.010901:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010907:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010931:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010937:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010942:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010947:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809585.010958:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010977:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010985:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54100) 00010000:00010000:2.0:1780809585.010988:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809585.010991:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.010997:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f371f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.011031:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721c5 expref: 71 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.011058:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3726 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721c5 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.011066:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809585.011068:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809585.011071:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:2.0:1780809585.011102:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:142406:x1867312334975616:12345-192.168.203.33@tcp:101:dd.0 Request processed in 823us (920us total) trans 55834578603 rc 0/0 00000100:00100000:2.0:1780809585.011109:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7487 00000100:00100000:1.0:1780809585.011738:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780809585.011752:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cae01ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338745600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780809585.011789:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809585.011819:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338745600 00000100:00100000:2.0:1780809585.011824:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338745600 00000100:00100000:2.0:1780809585.011858:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1780809585.011864:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338745600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780809585.011883:0:77632:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:2.0:1780809585.011930:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338745600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809585.011937:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1780809585.011990:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cae01ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338745600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780809585.012017:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809585.012044:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334975744 00000100:00100000:1.0:1780809585.012050:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334975744 00000100:00100000:1.0:1780809585.012085:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2140 00000100:00100000:1.0:1780809585.012095:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:2392:x1867312334975744:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809585.012105:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809585.012120:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3726 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721c5 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.012144:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809585.012148:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809585.012174:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:2392:x1867312334975744:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809585.012183:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2140 00000100:00100000:0.0:1780809585.099293:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809585.099361:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334975872 00000100:00100000:3.0:1780809585.099371:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334975872 00000100:00100000:3.0:1780809585.099417:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7488 00000100:00100000:3.0:1780809585.099425:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:142413:x1867312334975872:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809585.099446:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809585.099462:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721cc expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099509:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099520:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099527:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099536:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099539:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099543:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099807:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099816:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 70 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099821:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099844:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 70 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.099853:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 70 pid: 77628 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809585.099862:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee4f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338745728:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809585.099923:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd960d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809585.100670:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee4f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338745728:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809585.100687:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809585.100845:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809585.100883:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334976128 00000100:00100000:3.0:1780809585.100887:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334976128 00000100:00100000:3.0:1780809585.100919:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1788 00000100:00100000:3.0:1780809585.100926:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:90168:x1867312334976128:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809585.101078:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:90168:x1867312334976128:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 152us (234us total) trans 55834578604 rc 0/0 00000100:00100000:3.0:1780809585.101093:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1788 00000100:00100000:0.0:1780809585.101650:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809585.101691:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334976256 00000100:00100000:1.0:1780809585.101696:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334976256 00010000:00010000:1.0:1780809585.101713:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 72 pid: 77628 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809585.101733:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 545 00000100:00100000:1.0:1780809585.101738:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2394:x1867312334976256:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809585.101745:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809585.101750:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 72 pid: 77628 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.101760:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 72 pid: 77628 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.101781:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3677 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721a2 expref: 72 pid: 77628 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.101793:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809585.101796:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.101801:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.101805:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.101819:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809585.101839:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2394:x1867312334976256:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 102us (190us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809585.101843:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809585.101847:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 545 00010000:00010000:3.0:1780809585.101854:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809585.101873:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809585.101877:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809585.101888:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101899:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101908:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101914:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101921:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101927:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.101931:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101938:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101947:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809585.101956:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.101961:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101980:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f373b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101992:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.101999:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102005:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102010:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.102013:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102018:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102026:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809585.102028:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.102031:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102037:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102064:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102082:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 70 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.102087:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809585.102089:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809585.102090:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809585.102116:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:142413:x1867312334975872:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2689us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809585.102120:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7488 00000100:00100000:0.0:1780809585.103538:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809585.103567:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334976512 00000100:00100000:1.0:1780809585.103571:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334976512 00000100:00100000:1.0:1780809585.103609:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7489 00000100:00100000:1.0:1780809585.103615:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:142413:x1867312334976512:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809585.103625:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809585.103633:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721d3 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.103683:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.103704:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.103711:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.103732:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.103744:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 71 pid: 79214 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809585.103753:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338745856:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809585.103787:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc65ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1780809585.104431:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338745856:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809585.104440:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809585.104660:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809585.104692:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334976640 00000100:00100000:2.0:1780809585.104697:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334976640 00010000:00010000:2.0:1780809585.104712:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 72 pid: 79214 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809585.104737:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 546 00000100:00100000:2.0:1780809585.104742:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2393:x1867312334976640:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809585.104755:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809585.104759:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 72 pid: 79214 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.104767:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 72 pid: 79214 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.104776:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3749 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721cc expref: 72 pid: 79214 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.104783:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809585.104786:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.104791:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.104795:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.104812:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809585.104830:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809585.104832:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2393:x1867312334976640:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 90us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809585.104844:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809585.104845:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 546 00000004:00200000:1.0:1780809585.104855:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809585.104918:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 72 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.104944:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 71 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.104952:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809585.104954:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809585.104957:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:1.0:1780809585.104996:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142413:x1867312334976512:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1381us (1459us total) trans 55834578605 rc 0/0 00000100:00100000:1.0:1780809585.105001:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7489 00010000:00010000:0.0:1780809585.203681:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809585.291763:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809585.291816:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334976896 00000100:00100000:1.0:1780809585.291825:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334976896 00000100:00100000:1.0:1780809585.291872:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1789 00000100:00100000:1.0:1780809585.291879:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142406:x1867312334976896:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809585.292076:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142406:x1867312334976896:12345-192.168.203.33@tcp:35:dd.0 Request processed in 197us (320us total) trans 55834578606 rc 0/0 00000100:00100000:1.0:1780809585.292082:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1789 00000100:00100000:2.0:1780809585.431371:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809585.431419:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334977152 00000100:00100000:3.0:1780809585.431428:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334977152 00000100:00100000:3.0:1780809585.431476:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7490 00000100:00100000:3.0:1780809585.431484:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142421:x1867312334977152:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809585.431503:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809585.431519:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721da expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431574:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431584:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431614:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431624:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431639:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431644:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431899:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f377a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431906:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f377a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.431911:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f377a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809585.431918:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809585.432007:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432013:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432017:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432021:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.432023:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432028:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432044:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809585.432046:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.432049:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432053:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f376c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432060:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432064:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432067:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432070:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.432072:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432075:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432078:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809585.432080:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.432081:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432084:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432128:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721da expref: 75 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432139:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f377a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721da expref: 74 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.432143:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809585.432145:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809585.432147:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809585.432191:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:142421:x1867312334977152:12345-192.168.203.33@tcp:101:dd.0 Request processed in 707us (826us total) trans 55834578607 rc 0/0 00000100:00100000:3.0:1780809585.432198:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7490 00000100:00100000:0.0:1780809585.433122:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809585.433177:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334977280 00000100:00100000:1.0:1780809585.433183:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334977280 00000100:00100000:1.0:1780809585.433219:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2141 00000100:00100000:1.0:1780809585.433228:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2394:x1867312334977280:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809585.433237:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809585.433250:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f377a lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721da expref: 74 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.433262:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809585.433271:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809585.433306:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2394:x1867312334977280:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809585.433313:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2141 00000100:00100000:0.0:1780809585.523781:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338745984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780809585.523844:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809585.523880:0:82719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338745984 00000100:00100000:1.0:1780809585.523890:0:82719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338745984 00000100:00100000:1.0:1780809585.523941:0:82719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1780809585.523951:0:82719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338745984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780809585.523985:0:82719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:1.0:1780809585.524034:0:82719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338745984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809585.524042:0:82719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1780809585.524080:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338745984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780809585.618655:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809585.618710:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334977536 00000100:00100000:3.0:1780809585.618718:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334977536 00000100:00100000:3.0:1780809585.618764:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7491 00000100:00100000:3.0:1780809585.618774:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142427:x1867312334977536:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809585.618797:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809585.618814:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721e1 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.618870:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.618880:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.618888:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.618907:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.618912:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.618915:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619186:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f379d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619193:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f379d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619197:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f379d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809585.619207:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809585.619284:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619290:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619294:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619297:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.619300:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619312:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619321:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809585.619323:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.619326:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619330:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f378f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619338:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619341:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619344:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619348:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.619349:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619353:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619356:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809585.619357:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.619359:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619367:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3796 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619396:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e1 expref: 76 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619410:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f379d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e1 expref: 75 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.619417:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809585.619420:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809585.619422:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809585.619472:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:142427:x1867312334977536:12345-192.168.203.33@tcp:101:dd.0 Request processed in 700us (822us total) trans 55834578608 rc 0/0 00000100:00100000:3.0:1780809585.619479:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7491 00000100:00100000:2.0:1780809585.620405:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809585.620448:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334977792 00000100:00100000:3.0:1780809585.620453:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334977792 00000100:00100000:3.0:1780809585.620481:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1790 00000100:00100000:3.0:1780809585.620488:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:142427:x1867312334977792:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809585.620576:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809585.620613:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334977920 00000100:00100000:2.0:1780809585.620618:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334977920 00000100:00100000:3.0:1780809585.620638:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142427:x1867312334977792:12345-192.168.203.33@tcp:35:dd.0 Request processed in 148us (230us total) trans 55834578609 rc 0/0 00000100:00100000:3.0:1780809585.620652:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1790 00000100:00100000:2.0:1780809585.620662:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2142 00000100:00100000:2.0:1780809585.620679:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:2393:x1867312334977920:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809585.620689:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809585.620701:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f379d lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e1 expref: 76 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.620710:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809585.620713:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809585.620734:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:2393:x1867312334977920:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 59us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809585.620739:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2142 00000100:00100000:1.0:1780809585.644399:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809585.644439:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334978048 00000100:00100000:3.0:1780809585.644452:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334978048 00000100:00100000:3.0:1780809585.644494:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7492 00000100:00100000:3.0:1780809585.644500:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:142433:x1867312334978048:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809585.644530:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809585.644546:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f37ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721e8 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644620:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644635:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644653:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644668:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644676:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644682:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644928:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644937:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 76 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644942:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644979:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 76 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.644993:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 76 pid: 80225 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809585.645003:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee4f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338746112:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809585.645067:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd00ab9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809585.646447:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee4f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338746112:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809585.646463:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809585.646617:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809585.646674:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334978304 00000100:00100000:2.0:1780809585.646679:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334978304 00000100:00100000:2.0:1780809585.646704:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1791 00000100:00100000:2.0:1780809585.646709:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:89645:x1867312334978304:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809585.646876:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:89645:x1867312334978304:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 164us (257us total) trans 55834578610 rc 0/0 00000100:00100000:2.0:1780809585.646884:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1791 00000100:00100000:0.0:1780809585.647787:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809585.647840:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334978432 00000100:00100000:2.0:1780809585.647846:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334978432 00010000:00010000:2.0:1780809585.647866:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 78 pid: 80225 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809585.647909:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 547 00000100:00100000:2.0:1780809585.647917:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2394:x1867312334978432:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809585.647928:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809585.647934:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 78 pid: 80225 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.647955:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 78 pid: 80225 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.647984:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3757 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721d3 expref: 78 pid: 80225 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.647998:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809585.648002:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.648010:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.648017:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.648037:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809585.648070:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2394:x1867312334978432:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 152us (280us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809585.648071:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809585.648082:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 547 00010000:00010000:3.0:1780809585.648086:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809585.648116:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809585.648120:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809585.648133:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648144:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648155:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648161:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648194:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648202:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.648207:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648215:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648222:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809585.648224:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.648227:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648231:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648240:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648244:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648248:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648250:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809585.648252:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648263:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648268:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809585.648269:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809585.648271:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648274:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648296:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f37ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648305:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 76 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809585.648310:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809585.648311:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809585.648312:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809585.648337:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142433:x1867312334978048:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3838us (3948us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809585.648342:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7492 00000100:00100000:0.0:1780809585.651281:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809585.651320:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334978688 00000100:00100000:2.0:1780809585.651327:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334978688 00000100:00100000:2.0:1780809585.651363:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7493 00000100:00100000:2.0:1780809585.651369:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142433:x1867312334978688:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809585.651386:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809585.651399:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f37c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721ef expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.651482:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.651496:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.651503:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.651526:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.651534:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 77 pid: 77627 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809585.651544:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338746240:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809585.651613:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551d900 going to sleep for 11 seconds 00000100:00100000:2.0:1780809585.652367:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338746240:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809585.652384:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809585.652546:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809585.652574:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334978816 00000100:00100000:1.0:1780809585.652578:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334978816 00010000:00010000:1.0:1780809585.652613:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 78 pid: 77627 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809585.652634:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 548 00000100:00100000:1.0:1780809585.652640:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf63cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2393:x1867312334978816:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809585.652646:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809585.652650:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 78 pid: 77627 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.652658:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 78 pid: 77627 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.652682:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f37c0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721e8 expref: 78 pid: 77627 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.652696:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809585.652701:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.652709:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.652716:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809585.652732:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809585.652749:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.652756:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809585.652759:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf63cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2393:x1867312334978816:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 118us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809585.652768:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 548 00000004:00200000:2.0:1780809585.652772:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809585.652874:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f37c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 78 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.652900:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 77 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809585.652906:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809585.652908:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809585.652910:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:2.0:1780809585.652934:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142433:x1867312334978688:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1565us (1658us total) trans 55834578611 rc 0/0 00000100:00100000:2.0:1780809585.652940:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7493 00000100:00100000:0.0:1780809585.731752:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809585.731814:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334979072 00000100:00100000:3.0:1780809585.731822:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334979072 00000100:00100000:3.0:1780809585.731862:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1792 00000100:00100000:3.0:1780809585.731870:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142421:x1867312334979072:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809585.732078:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:142421:x1867312334979072:12345-192.168.203.33@tcp:35:dd.0 Request processed in 209us (333us total) trans 55834578612 rc 0/0 00000100:00100000:3.0:1780809585.732083:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1792 00000100:00100000:0.0:1780809586.058367:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.058445:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334979328 00000100:00100000:3.0:1780809586.058455:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334979328 00000100:00080000:0.0:1780809586.058507:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809586.058532:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7494 00000100:00100000:3.0:1780809586.058545:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:142449:x1867312334979328:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809586.058567:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809586.058624:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f37dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721f6 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.058693:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.058707:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.058719:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.058733:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.058741:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.058748:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059120:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f37f1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059136:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f37f1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059144:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f37f1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809586.059156:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809586.059252:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059260:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059267:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059272:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.059276:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059284:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059295:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809586.059298:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.059302:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059309:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f37e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059329:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059336:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059341:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059346:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.059349:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059356:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059362:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809586.059365:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.059368:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059374:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f37ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059410:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f37dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721f6 expref: 81 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059423:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f37f1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721f6 expref: 80 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.059440:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809586.059442:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809586.059445:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809586.059497:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:142449:x1867312334979328:12345-192.168.203.33@tcp:101:dd.0 Request processed in 955us (1137us total) trans 55834578613 rc 0/0 00000100:00100000:3.0:1780809586.059504:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7494 00000100:00100000:0.0:1780809586.060634:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.060697:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334979456 00000100:00100000:2.0:1780809586.060702:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334979456 00000100:00100000:2.0:1780809586.060744:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2143 00000100:00100000:2.0:1780809586.060752:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:2391:x1867312334979456:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809586.060763:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809586.060778:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f37f1 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721f6 expref: 80 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.060800:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.060804:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809586.060835:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2391:x1867312334979456:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.060842:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2143 00000100:00100000:0.0:1780809586.071542:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.071615:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334979712 00000100:00100000:1.0:1780809586.071624:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334979712 00000100:00100000:1.0:1780809586.071670:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7495 00000100:00100000:1.0:1780809586.071679:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142455:x1867312334979712:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809586.071703:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809586.071720:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f37ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468721fd expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.071782:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.071810:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.071822:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.071836:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.071843:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.071849:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072153:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3814 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072162:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3814 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072169:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3814 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809586.072178:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809586.072249:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072256:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072263:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072274:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809586.072278:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072286:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072296:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809586.072299:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809586.072304:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072310:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072320:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072326:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072332:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072337:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809586.072340:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072345:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072371:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809586.072373:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809586.072376:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072382:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f380d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072415:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f37ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721fd expref: 82 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072426:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3814 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721fd expref: 81 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.072433:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809586.072436:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809586.072438:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64a00, rc 0) 00000100:00100000:1.0:1780809586.072484:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:142455:x1867312334979712:12345-192.168.203.33@tcp:101:dd.0 Request processed in 806us (947us total) trans 55834578614 rc 0/0 00000100:00100000:1.0:1780809586.072491:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7495 00000100:00100000:0.0:1780809586.073512:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809586.073533:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.073556:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334979840 00000100:00100000:2.0:1780809586.073562:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334979840 00000100:00100000:1.0:1780809586.073566:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334980096 00000100:00100000:1.0:1780809586.073571:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334980096 00000100:00100000:1.0:1780809586.073619:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1793 00000100:00100000:2.0:1780809586.073628:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2144 00000100:00100000:1.0:1780809586.073629:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142455:x1867312334980096:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809586.073646:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2394:x1867312334979840:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809586.073656:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809586.073666:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3814 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721fd expref: 82 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.073675:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.073678:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809586.073703:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2394:x1867312334979840:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.073708:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2144 00000100:00100000:1.0:1780809586.073733:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:142455:x1867312334980096:12345-192.168.203.33@tcp:35:dd.0 Request processed in 98us (188us total) trans 55834578615 rc 0/0 00000100:00100000:1.0:1780809586.073741:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1793 00000100:00100000:0.0:1780809586.174775:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809586.174817:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.174847:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334980224 00000100:00100000:3.0:1780809586.174857:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334980224 00000100:00100000:1.0:1780809586.174873:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334980352 00000100:00100000:1.0:1780809586.174881:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334980352 00000100:00100000:0.0:1780809586.174899:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.174910:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 385 00000100:00100000:3.0:1780809586.174922:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf4fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312334980224:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809586.174936:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1084 00000100:00100000:1.0:1780809586.174947:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312334980352:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809586.174976:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334980480 00000100:00100000:2.0:1780809586.174982:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334980480 00000100:00100000:3.0:1780809586.175007:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf4fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312334980224:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809586.175015:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312334980352:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809586.175019:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.175025:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 654 00000100:00100000:3.0:1780809586.175027:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 385 00000100:00100000:1.0:1780809586.175033:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1084 00000100:00100000:2.0:1780809586.175039:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2392:x1867312334980480:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809586.175055:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334980736 00000100:00100000:1.0:1780809586.175060:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334980736 00000100:00100000:2.0:1780809586.175082:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2392:x1867312334980480:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.175090:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 654 00000100:00100000:1.0:1780809586.175101:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1085 00000100:00100000:1.0:1780809586.175112:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312334980736:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:2.0:1780809586.175128:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780809586.175143:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780809586.175144:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312334980736:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00080000:2.0:1780809586.175148:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780809586.175156:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1085 00000100:00100000:3.0:1780809586.175184:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.175228:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334980608 00000100:00100000:2.0:1780809586.175234:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334980608 00000100:00100000:3.0:1780809586.175238:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00080000:3.0:1780809586.175278:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780809586.175279:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 278 00000100:00100000:1.0:1780809586.175288:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334980864 00000100:00100000:2.0:1780809586.175290:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2390:x1867312334980608:12345-192.168.203.33@tcp:9:kworker.0 00000100:00100000:1.0:1780809586.175294:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334980864 00000020:00000080:2.0:1780809586.175311:0:79836:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x25b625638c8f2528 00000100:00080000:3.0:1780809586.175324:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780809586.175331:0:79836:0:(import.c:65:import_set_state_nolock()) ffff9cacc62ed000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1780809586.175337:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1086 00000100:00100000:1.0:1780809586.175347:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312334980864:12345-192.168.203.33@tcp:400:kworker.0 00000001:00000004:2.0:1780809586.175381:0:79836:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 13, last_transno is 55834575018 00010000:00010000:3.0:1780809586.175385:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809586.175387:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312334980864:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 40us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809586.175397:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1086 00000100:00100000:2.0:1780809586.175650:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+2:2390:x1867312334980608:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 361us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.175657:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 278 00010000:00010000:1.0:1780809586.227744:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809586.337902:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.337968:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334981120 00000100:00100000:2.0:1780809586.337976:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334981120 00000100:00100000:2.0:1780809586.338015:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1794 00000100:00100000:2.0:1780809586.338021:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:142449:x1867312334981120:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809586.338193:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142449:x1867312334981120:12345-192.168.203.33@tcp:35:dd.0 Request processed in 172us (301us total) trans 55834578616 rc 0/0 00000100:00100000:2.0:1780809586.338197:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1794 00000100:00100000:0.0:1780809586.376388:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.376441:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334981248 00000100:00100000:2.0:1780809586.376450:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334981248 00000100:00100000:2.0:1780809586.376502:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7496 00000100:00100000:2.0:1780809586.376511:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142464:x1867312334981248:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809586.376533:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809586.376549:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872204 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376628:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376641:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376651:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376680:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376688:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376695:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376985:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.376996:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 83 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.377004:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.377033:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 83 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.377046:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 83 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809586.377059:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338746368:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809586.377129:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551d900 going to sleep for 11 seconds 00000100:00100000:2.0:1780809586.377817:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338746368:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809586.377832:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809586.378001:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.378041:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334981504 00000100:00100000:1.0:1780809586.378046:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334981504 00000100:00100000:1.0:1780809586.378069:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1795 00000100:00100000:1.0:1780809586.378074:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:90168:x1867312334981504:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809586.378221:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:90168:x1867312334981504:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 146us (221us total) trans 55834578617 rc 0/0 00000100:00100000:1.0:1780809586.378227:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1795 00000100:00100000:0.0:1780809586.378785:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.378824:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334981632 00000100:00100000:1.0:1780809586.378828:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334981632 00010000:00010000:1.0:1780809586.378842:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809586.378860:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 549 00000100:00100000:1.0:1780809586.378864:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:2393:x1867312334981632:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809586.378871:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809586.378875:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.378884:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.378895:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f37ce lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468721ef expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.378920:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809586.378923:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.378928:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.378941:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.378969:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809586.378997:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312334981632:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 131us (211us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809586.379000:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809586.379010:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 549 00010000:00010000:2.0:1780809586.379012:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809586.379039:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809586.379043:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809586.379057:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379067:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379075:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379081:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379089:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379095:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809586.379099:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379106:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379115:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809586.379124:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809586.379129:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379135:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379155:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379162:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379168:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379173:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809586.379176:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379182:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379190:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54100) 00010000:00010000:2.0:1780809586.379192:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809586.379195:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379201:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3830 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379228:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 84 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379255:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 83 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.379263:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.379265:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809586.379268:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809586.379298:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:142464:x1867312334981248:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2788us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.379305:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7496 00000100:00100000:0.0:1780809586.380448:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.380479:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334981888 00000100:00100000:3.0:1780809586.380484:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334981888 00000100:00100000:3.0:1780809586.380510:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7497 00000100:00100000:3.0:1780809586.380519:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:142464:x1867312334981888:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809586.380529:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809586.380538:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f383e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687220b expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.380603:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.380612:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 84 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.380617:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.380640:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 84 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.380647:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 84 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809586.380653:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338746496:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809586.380684:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae018f8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780809586.381200:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338746496:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809586.381216:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809586.381329:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.381356:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334982016 00000100:00100000:2.0:1780809586.381360:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334982016 00010000:00010000:2.0:1780809586.381373:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809586.381392:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 550 00000100:00100000:2.0:1780809586.381396:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:2393:x1867312334982016:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809586.381402:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809586.381405:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.381413:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.381422:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3837 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872204 expref: 85 pid: 78216 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.381439:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.381442:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.381447:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.381450:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.381462:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809586.381482:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312334982016:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 85us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809586.381484:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809586.381489:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 550 00010000:00010000:1.0:1780809586.381497:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809586.381509:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809586.381581:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f383e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 85 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.381616:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 84 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.381624:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809586.381626:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809586.381629:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:1.0:1780809586.381664:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:142464:x1867312334981888:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1142us (1211us total) trans 55834578618 rc 0/0 00000100:00100000:1.0:1780809586.381678:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7497 00000040:00080000:1.0:1780809586.420037:0:77663:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1780809586.459270:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.459320:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334982272 00000100:00100000:1.0:1780809586.459328:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334982272 00000100:00100000:1.0:1780809586.459370:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7498 00000100:00100000:1.0:1780809586.459377:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:142471:x1867312334982272:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809586.459396:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809586.459411:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872212 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459464:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459474:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459481:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459490:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459494:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459498:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459801:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3868 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459813:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3868 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459818:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3868 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809586.459825:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809586.459893:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459898:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459902:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459906:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809586.459909:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459913:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459921:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809586.459923:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809586.459927:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459930:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f385a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459944:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459948:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459951:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459966:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809586.459968:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459971:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459976:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809586.459977:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809586.459979:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.459982:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3861 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.460011:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872212 expref: 87 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.460018:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3868 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872212 expref: 86 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.460030:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809586.460031:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809586.460033:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64400, rc 0) 00000100:00100000:1.0:1780809586.460076:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:142471:x1867312334982272:12345-192.168.203.33@tcp:101:dd.0 Request processed in 700us (815us total) trans 55834578619 rc 0/0 00000100:00100000:1.0:1780809586.460081:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7498 00000100:00100000:3.0:1780809586.461030:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.461079:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334982400 00000100:00100000:2.0:1780809586.461085:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334982400 00000100:00100000:2.0:1780809586.461118:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2145 00000100:00100000:2.0:1780809586.461126:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:2393:x1867312334982400:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809586.461137:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809586.461149:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3868 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872212 expref: 86 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.461160:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.461165:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809586.461192:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:2393:x1867312334982400:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 67us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.461200:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2145 00000100:00100000:0.0:1780809586.506894:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.506960:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334982528 00000100:00100000:3.0:1780809586.506968:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334982528 00000100:00100000:3.0:1780809586.507009:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7499 00000100:00100000:3.0:1780809586.507016:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:142477:x1867312334982528:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809586.507037:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809586.507052:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872219 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507096:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507117:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507128:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507143:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507150:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507157:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507377:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507385:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 86 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507390:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507413:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 86 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.507422:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 86 pid: 77628 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809586.507440:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338746624:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809586.507501:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae018f8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809586.509849:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.509855:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338746624:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809586.509881:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809586.509897:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334982784 00000100:00100000:2.0:1780809586.509902:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334982784 00000100:00100000:2.0:1780809586.509928:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1796 00000100:00100000:2.0:1780809586.509932:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+87:89646:x1867312334982784:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809586.510093:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+88:89646:x1867312334982784:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 160us (247us total) trans 55834578620 rc 0/0 00000100:00100000:2.0:1780809586.510098:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1796 00000100:00100000:0.0:1780809586.510645:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.510689:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334982912 00000100:00100000:1.0:1780809586.510693:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334982912 00010000:00010000:1.0:1780809586.510710:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 88 pid: 77628 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809586.510729:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 551 00000100:00100000:1.0:1780809586.510734:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+88:2391:x1867312334982912:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809586.510740:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809586.510745:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 88 pid: 77628 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.510754:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 88 pid: 77628 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.510768:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3845 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687220b expref: 88 pid: 77628 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.510777:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809586.510780:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.510790:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.510795:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.510809:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809586.510831:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+87:2391:x1867312334982912:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 95us (185us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809586.510838:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809586.510839:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 551 00010000:00010000:3.0:1780809586.510849:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809586.510875:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809586.510879:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809586.510891:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510901:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510911:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510917:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510924:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510939:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.510944:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510951:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510973:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809586.510975:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.510979:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510985:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f387d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.510996:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511003:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511008:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511013:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.511016:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511021:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511038:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809586.511041:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.511044:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511050:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3884 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511077:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 87 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511089:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 86 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.511096:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809586.511098:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809586.511101:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809586.511131:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:142477:x1867312334982528:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 4114us (4244us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809586.511139:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7499 00000100:00100000:0.0:1780809586.512419:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.512456:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334983168 00000100:00100000:1.0:1780809586.512461:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334983168 00000100:00100000:1.0:1780809586.512492:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7500 00000100:00100000:1.0:1780809586.512498:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:142477:x1867312334983168:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809586.512507:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809586.512515:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872220 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.512555:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.512562:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 87 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.512567:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.512582:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 87 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.512618:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 87 pid: 79214 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809586.512629:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338746752:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809586.512662:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc65ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1780809586.513197:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338746752:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809586.513210:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809586.513292:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.513326:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334983296 00000100:00100000:2.0:1780809586.513330:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334983296 00010000:00010000:2.0:1780809586.513342:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 88 pid: 79214 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809586.513365:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 552 00000100:00100000:2.0:1780809586.513374:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf63cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+88:2393:x1867312334983296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809586.513383:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809586.513388:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 88 pid: 79214 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.513397:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 88 pid: 79214 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.513412:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f388b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872219 expref: 88 pid: 79214 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.513420:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.513423:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.513441:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.513447:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.513465:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809586.513483:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.513490:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809586.513492:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf63cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+87:2393:x1867312334983296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 118us (200us total) trans 0 rc 0/0 00000004:00200000:1.0:1780809586.513499:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809586.513504:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 552 00010000:00010000:1.0:1780809586.513582:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 88 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.513617:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 87 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.513624:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809586.513626:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809586.513628:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64c00, rc 0) 00000100:00100000:1.0:1780809586.513651:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+87:142477:x1867312334983168:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1154us (1235us total) trans 55834578621 rc 0/0 00000100:00100000:1.0:1780809586.513660:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7500 00000100:00100000:0.0:1780809586.521013:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.521055:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334983552 00000100:00100000:3.0:1780809586.521061:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334983552 00000100:00100000:3.0:1780809586.521092:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7501 00000100:00100000:3.0:1780809586.521098:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+87:142483:x1867312334983552:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809586.521112:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809586.521124:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f38a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872227 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521187:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521196:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521202:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521210:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521214:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521218:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521474:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f38bc lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521480:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f38bc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521484:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f38bc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809586.521491:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809586.521547:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521559:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521563:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521566:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.521569:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521574:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521581:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809586.521583:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.521607:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521611:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521619:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521623:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521627:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521630:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.521635:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521639:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521644:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809586.521645:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.521647:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521650:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521674:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f38a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872227 expref: 90 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521682:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f38bc lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872227 expref: 89 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.521686:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809586.521688:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809586.521689:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809586.521723:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+89:142483:x1867312334983552:12345-192.168.203.33@tcp:101:dd.0 Request processed in 626us (716us total) trans 55834578622 rc 0/0 00000100:00100000:3.0:1780809586.521728:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7501 00000100:00100000:0.0:1780809586.523858:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.523893:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334983680 00000100:00100000:0.0:1780809586.523899:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.523901:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334983680 00000100:00100000:1.0:1780809586.523941:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334983936 00000100:00100000:2.0:1780809586.523945:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2146 00000100:00100000:1.0:1780809586.523948:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334983936 00000100:00100000:2.0:1780809586.523968:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+90:2392:x1867312334983680:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809586.523979:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780809586.523998:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1797 00010000:00010000:2.0:1780809586.524002:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f38bc lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872227 expref: 90 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809586.524011:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+90:142483:x1867312334983936:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809586.524020:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.524026:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809586.524061:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+89:2392:x1867312334983680:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.524069:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2146 00000100:00100000:1.0:1780809586.524143:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+89:142483:x1867312334983936:12345-192.168.203.33@tcp:35:dd.0 Request processed in 135us (243us total) trans 55834578623 rc 0/0 00000100:00100000:1.0:1780809586.524150:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1797 00000001:00080000:3.0:1780809586.553741:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578623 is committed 00000100:00100000:0.0:1780809586.669079:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.669136:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334984192 00000100:00100000:2.0:1780809586.669144:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334984192 00000100:00100000:2.0:1780809586.669185:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7502 00000100:00100000:2.0:1780809586.669192:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+17:142491:x1867312334984192:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809586.669224:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809586.669240:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f38ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687222e expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669291:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669301:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669308:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669316:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669320:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669323:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669572:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f38df lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669578:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f38df lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669582:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f38df lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809586.669614:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809586.669711:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669716:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669720:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669723:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809586.669727:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669731:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669739:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809586.669741:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809586.669744:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669748:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f38d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669765:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669769:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669772:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669782:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809586.669783:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669788:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669795:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:2.0:1780809586.669797:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809586.669800:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669805:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f38d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669841:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f38ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687222e expref: 20 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669859:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f38df lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687222e expref: 19 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.669864:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.669865:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809586.669867:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f800, rc 0) 00000100:00100000:2.0:1780809586.669912:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:142491:x1867312334984192:12345-192.168.203.33@tcp:101:dd.0 Request processed in 720us (839us total) trans 55834578624 rc 0/0 00000100:00100000:2.0:1780809586.669919:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7502 00000100:00100000:0.0:1780809586.670845:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.670877:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334984320 00000100:00100000:0.0:1780809586.670882:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.670883:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334984320 00000100:00100000:2.0:1780809586.670909:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334984576 00000100:00100000:2.0:1780809586.670918:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334984576 00000100:00100000:1.0:1780809586.670929:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2147 00000100:00100000:1.0:1780809586.670940:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2393:x1867312334984320:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1780809586.670947:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1798 00010000:00010000:1.0:1780809586.670950:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1780809586.670969:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef1d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142491:x1867312334984576:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809586.670974:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f38df lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687222e expref: 20 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809586.670991:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809586.670994:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809586.671024:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2393:x1867312334984320:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 87us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809586.671029:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2147 00000100:00100000:2.0:1780809586.671063:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef1d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:142491:x1867312334984576:12345-192.168.203.33@tcp:35:dd.0 Request processed in 109us (180us total) trans 55834578625 rc 0/0 00000100:00100000:2.0:1780809586.671069:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1798 00000100:00100000:0.0:1780809586.767942:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809586.767998:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334984832 00000100:00100000:1.0:1780809586.768006:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334984832 00000100:00100000:1.0:1780809586.768049:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1799 00000100:00100000:1.0:1780809586.768055:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:142471:x1867312334984832:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809586.768242:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142471:x1867312334984832:12345-192.168.203.33@tcp:35:dd.0 Request processed in 186us (308us total) trans 55834578626 rc 0/0 00000100:00100000:1.0:1780809586.768247:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1799 00000100:00100000:0.0:1780809586.989875:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809586.989980:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334985088 00000100:00100000:3.0:1780809586.989989:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334985088 00000100:00100000:3.0:1780809586.990036:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7503 00000100:00100000:3.0:1780809586.990054:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142506:x1867312334985088:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809586.990075:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809586.990090:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f38ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872235 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990151:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990163:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990172:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990185:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990192:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990199:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990449:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3902 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990456:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3902 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990461:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3902 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809586.990476:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809586.990540:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990545:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990549:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990553:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.990555:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990560:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990567:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809586.990569:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.990573:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990577:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f38f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990584:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990622:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990633:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990637:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809586.990639:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990643:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990650:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809586.990651:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809586.990654:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990658:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f38fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990687:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f38ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872235 expref: 23 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990696:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3902 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872235 expref: 22 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809586.990700:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809586.990701:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809586.990703:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809586.990745:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142506:x1867312334985088:12345-192.168.203.33@tcp:101:dd.0 Request processed in 693us (878us total) trans 55834578627 rc 0/0 00000100:00100000:3.0:1780809586.990756:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7503 00000100:00100000:0.0:1780809586.991791:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809586.991844:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334985216 00000100:00100000:2.0:1780809586.991848:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334985216 00000100:00100000:2.0:1780809586.991874:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2148 00000100:00100000:2.0:1780809586.991879:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:2394:x1867312334985216:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809586.991887:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809586.991899:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3902 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872235 expref: 22 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809586.991913:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809586.991917:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809586.991960:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:2394:x1867312334985216:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809586.991967:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2148 00000100:00100000:0.0:1780809587.041720:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.041777:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334985344 00000100:00100000:1.0:1780809587.041787:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334985344 00000100:00100000:1.0:1780809587.041836:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7504 00000100:00100000:1.0:1780809587.041843:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:142512:x1867312334985344:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809587.041864:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809587.041878:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3910 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687223c expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.041936:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.041964:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.041976:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.041990:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.041998:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.042010:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.042339:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.042358:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 22 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.042367:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.042395:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 22 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.042408:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 22 pid: 77629 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.042422:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338746880:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809587.042488:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc65ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1780809587.043201:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338746880:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809587.043216:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809587.043450:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.043496:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334985600 00000100:00100000:2.0:1780809587.043501:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334985600 00000100:00100000:2.0:1780809587.043529:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1800 00000100:00100000:2.0:1780809587.043534:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:90168:x1867312334985600:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1780809587.043674:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:90168:x1867312334985600:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 140us (224us total) trans 55834578628 rc 0/0 00000100:00100000:2.0:1780809587.043680:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1800 00000100:00100000:0.0:1780809587.044269:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.044305:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334985728 00000100:00100000:2.0:1780809587.044309:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334985728 00010000:00010000:2.0:1780809587.044325:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 24 pid: 77629 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.044348:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 553 00000100:00100000:2.0:1780809587.044354:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2393:x1867312334985728:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809587.044363:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809587.044369:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 24 pid: 77629 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.044382:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 24 pid: 77629 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.044398:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3899 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872220 expref: 24 pid: 77629 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.044411:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.044415:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.044423:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.044430:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.044448:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809587.044470:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.044473:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2393:x1867312334985728:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 117us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809587.044476:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.044490:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 553 00000004:00200000:1.0:1780809587.044500:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809587.044504:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809587.044513:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044528:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044535:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044539:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044543:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044546:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.044549:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044553:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044559:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809587.044561:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.044564:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044567:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044573:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044577:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044584:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044615:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.044617:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044621:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044627:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809587.044628:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.044630:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044634:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f391e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044656:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 23 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044664:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 22 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.044669:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809587.044670:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809587.044672:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65800, rc 0) 00000100:00100000:1.0:1780809587.044692:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142512:x1867312334985344:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2851us (2979us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809587.044704:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7504 00000100:00100000:0.0:1780809587.046051:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809587.046088:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334985984 00000100:00100000:3.0:1780809587.046092:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334985984 00000100:00100000:3.0:1780809587.046119:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7505 00000100:00100000:3.0:1780809587.046128:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142512:x1867312334985984:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809587.046141:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809587.046153:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f392c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872243 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.046205:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.046213:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 23 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.046218:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.046235:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 23 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.046242:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 23 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809587.046249:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338747008:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809587.046289:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae00e4e480 going to sleep for 11 seconds 00000100:00100000:3.0:1780809587.046860:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338747008:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809587.046881:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809587.047057:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.047084:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334986112 00000100:00100000:1.0:1780809587.047088:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334986112 00010000:00010000:1.0:1780809587.047101:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 24 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.047121:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 554 00000100:00100000:1.0:1780809587.047125:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2394:x1867312334986112:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809587.047131:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809587.047135:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 24 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.047143:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 24 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.047153:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3925 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687223c expref: 24 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.047160:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809587.047163:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.047168:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.047172:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.047192:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809587.047213:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2394:x1867312334986112:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 87us (155us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809587.047216:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.047219:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 554 00010000:00010000:3.0:1780809587.047228:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809587.047239:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809587.047321:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f392c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 24 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.047334:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 23 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.047342:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809587.047345:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809587.047347:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809587.047374:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:142512:x1867312334985984:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1248us (1325us total) trans 55834578629 rc 0/0 00000100:00100000:3.0:1780809587.047385:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7505 00000100:00100000:0.0:1780809587.121668:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.121755:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334986368 00000100:00100000:1.0:1780809587.121765:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334986368 00000100:00100000:1.0:1780809587.121811:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7506 00000100:00100000:1.0:1780809587.121818:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:142519:x1867312334986368:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809587.121837:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809587.121853:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687224a expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.121906:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.121925:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.121933:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.121941:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.121946:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.121959:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122216:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3956 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122223:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3956 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122228:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3956 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809587.122235:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809587.122305:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122310:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122315:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122318:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.122321:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122326:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122334:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809587.122336:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.122339:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122349:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122357:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122361:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122365:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122370:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.122372:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122378:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122386:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809587.122388:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.122391:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122397:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f394f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122429:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687224a expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122447:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3956 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687224a expref: 25 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.122452:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809587.122453:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809587.122455:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64000, rc 0) 00000100:00100000:1.0:1780809587.122499:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142519:x1867312334986368:12345-192.168.203.33@tcp:101:dd.0 Request processed in 680us (838us total) trans 55834578630 rc 0/0 00000100:00100000:1.0:1780809587.122506:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7506 00000100:00100000:0.0:1780809587.123415:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809587.123450:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.123458:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334986496 00000100:00100000:2.0:1780809587.123463:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334986496 00000100:00100000:1.0:1780809587.123479:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334986752 00000100:00100000:1.0:1780809587.123483:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334986752 00000100:00100000:2.0:1780809587.123500:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2149 00000100:00100000:2.0:1780809587.123509:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2393:x1867312334986496:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809587.123513:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1801 00010000:00010000:2.0:1780809587.123517:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780809587.123522:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:142519:x1867312334986752:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809587.123529:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f3956 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687224a expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.123539:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.123542:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809587.123566:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:2393:x1867312334986496:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 60us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809587.123571:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2149 00000100:00100000:1.0:1780809587.123643:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142519:x1867312334986752:12345-192.168.203.33@tcp:35:dd.0 Request processed in 123us (192us total) trans 55834578631 rc 0/0 00000100:00100000:1.0:1780809587.123648:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1801 00010000:00010000:0.0:1780809587.251682:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809587.267029:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809587.267083:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334987008 00000100:00100000:3.0:1780809587.267092:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334987008 00000100:00100000:3.0:1780809587.267137:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7507 00000100:00100000:3.0:1780809587.267144:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142526:x1867312334987008:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809587.267163:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809587.267180:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872251 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267257:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267268:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267276:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267284:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267288:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267292:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267538:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3979 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267544:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3979 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267549:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3979 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809587.267556:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809587.267640:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267652:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267656:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267660:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809587.267662:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267668:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267676:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809587.267677:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809587.267680:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267684:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f396b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267693:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267697:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267700:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267703:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809587.267708:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267712:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267716:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809587.267717:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809587.267718:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267721:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3972 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267747:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872251 expref: 28 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267755:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3979 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872251 expref: 27 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.267759:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809587.267760:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809587.267761:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809587.267802:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:142526:x1867312334987008:12345-192.168.203.33@tcp:101:dd.0 Request processed in 659us (781us total) trans 55834578632 rc 0/0 00000100:00100000:3.0:1780809587.267807:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7507 00000100:00100000:0.0:1780809587.268785:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809587.268821:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.268834:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334987136 00000100:00100000:2.0:1780809587.268840:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334987136 00000100:00100000:3.0:1780809587.268856:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334987392 00000100:00100000:3.0:1780809587.268862:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334987392 00000100:00100000:2.0:1780809587.268886:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2150 00000100:00100000:2.0:1780809587.268897:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf63cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2391:x1867312334987136:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809587.268904:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1802 00010000:00010000:2.0:1780809587.268911:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809587.268917:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:142526:x1867312334987392:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809587.268929:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3979 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872251 expref: 28 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.268960:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.268965:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809587.268997:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf63cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2391:x1867312334987136:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 103us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809587.269013:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2150 00000100:00100000:3.0:1780809587.269039:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:142526:x1867312334987392:12345-192.168.203.33@tcp:35:dd.0 Request processed in 124us (214us total) trans 55834578633 rc 0/0 00000100:00100000:3.0:1780809587.269048:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1802 00000100:00100000:0.0:1780809587.299807:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.299858:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334987648 00000100:00100000:1.0:1780809587.299866:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334987648 00000100:00100000:1.0:1780809587.299916:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1803 00000100:00100000:1.0:1780809587.299928:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:142506:x1867312334987648:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809587.300152:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:142506:x1867312334987648:12345-192.168.203.33@tcp:35:dd.0 Request processed in 227us (351us total) trans 55834578634 rc 0/0 00000100:00100000:1.0:1780809587.300159:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1803 00000100:00100000:0.0:1780809587.470053:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.470103:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334987776 00000100:00100000:2.0:1780809587.470120:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334987776 00000100:00100000:2.0:1780809587.470174:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7508 00000100:00100000:2.0:1780809587.470185:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:142534:x1867312334987776:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809587.470206:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809587.470224:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872258 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470276:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470289:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470299:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470311:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470317:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470323:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470629:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470651:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 29 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470660:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470689:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 29 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.470702:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 29 pid: 79214 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.470718:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338747136:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809587.470778:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc576bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1780809587.471449:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338747136:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809587.471465:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809587.471638:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809587.471677:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334988032 00000100:00100000:3.0:1780809587.471682:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334988032 00000100:00100000:3.0:1780809587.471711:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1804 00000100:00100000:3.0:1780809587.471719:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf6a91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:89646:x1867312334988032:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809587.471853:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf6a91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:89646:x1867312334988032:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 134us (213us total) trans 55834578635 rc 0/0 00000100:00100000:3.0:1780809587.471860:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1804 00000100:00100000:0.0:1780809587.472417:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.472457:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334988160 00000100:00100000:1.0:1780809587.472467:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334988160 00010000:00010000:1.0:1780809587.472483:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 31 pid: 79214 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.472505:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 555 00000100:00100000:1.0:1780809587.472511:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2394:x1867312334988160:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809587.472518:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809587.472522:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 31 pid: 79214 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.472530:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 31 pid: 79214 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.472542:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3933 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872243 expref: 31 pid: 79214 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.472551:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809587.472554:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.472559:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.472563:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.472576:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809587.472618:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.472622:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2394:x1867312334988160:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 111us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809587.472634:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.472642:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 555 00000004:00200000:2.0:1780809587.472658:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809587.472662:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809587.472672:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472689:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472695:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472699:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472703:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472707:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809587.472710:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472714:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472719:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809587.472721:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809587.472724:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472727:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f398e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472743:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472747:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472754:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472758:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809587.472760:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472763:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472767:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:2.0:1780809587.472768:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809587.472770:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472773:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3995 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472791:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 30 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472808:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 29 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.472813:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.472814:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809587.472816:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:2.0:1780809587.472839:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:142534:x1867312334987776:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2657us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809587.472850:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7508 00000100:00100000:0.0:1780809587.474023:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809587.474063:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334988416 00000100:00100000:3.0:1780809587.474068:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334988416 00000100:00100000:3.0:1780809587.474093:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7509 00000100:00100000:3.0:1780809587.474101:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:142534:x1867312334988416:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809587.474119:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809587.474129:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f39a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687225f expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.474173:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.474183:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 30 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.474191:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.474221:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 30 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.474232:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 30 pid: 78216 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809587.474250:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338747264:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809587.474290:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd09a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1780809587.474868:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338747264:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809587.474882:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809587.475027:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.475059:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334988544 00000100:00100000:2.0:1780809587.475064:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334988544 00010000:00010000:2.0:1780809587.475082:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 31 pid: 78216 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.475108:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 556 00000100:00100000:2.0:1780809587.475116:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2393:x1867312334988544:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809587.475123:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809587.475129:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 31 pid: 78216 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.475139:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 31 pid: 78216 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.475152:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f399c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872258 expref: 31 pid: 78216 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.475166:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.475171:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.475178:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.475184:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.475212:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809587.475234:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.475241:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2393:x1867312334988544:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 123us (211us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809587.475243:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.475257:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 556 00000004:00200000:3.0:1780809587.475258:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809587.475314:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f39a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 31 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.475322:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 30 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.475327:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809587.475329:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809587.475335:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809587.475358:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:142534:x1867312334988416:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1257us (1333us total) trans 55834578636 rc 0/0 00000100:00100000:3.0:1780809587.475365:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7509 00000100:00100000:0.0:1780809587.597962:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.598015:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334988672 00000100:00100000:1.0:1780809587.598024:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334988672 00000100:00100000:1.0:1780809587.598075:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7510 00000100:00100000:1.0:1780809587.598084:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:142541:x1867312334988672:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809587.598106:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809587.598123:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872266 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598177:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598190:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598200:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598212:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598219:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598225:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598537:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598557:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 31 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598565:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598628:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 31 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.598642:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 31 pid: 77628 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.598652:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338747392:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809587.598707:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd03b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780809587.599439:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338747392:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809587.599452:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809587.599668:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.599709:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334988928 00000100:00100000:1.0:1780809587.599719:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334988928 00000100:00100000:1.0:1780809587.599752:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1805 00000100:00100000:1.0:1780809587.599762:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:89646:x1867312334988928:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809587.599894:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:89646:x1867312334988928:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 134us (226us total) trans 55834578637 rc 0/0 00000100:00100000:1.0:1780809587.599903:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1805 00000100:00100000:0.0:1780809587.600519:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.600576:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334989056 00000100:00100000:2.0:1780809587.600581:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334989056 00010000:00010000:2.0:1780809587.600628:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 33 pid: 77628 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.600656:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 557 00000100:00100000:2.0:1780809587.600664:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2394:x1867312334989056:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809587.600674:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809587.600680:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 33 pid: 77628 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.600691:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 33 pid: 77628 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.600707:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f39aa lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687225f expref: 33 pid: 77628 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.600720:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.600729:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.600738:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.600754:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.600774:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809587.600793:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.600803:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:2394:x1867312334989056:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809587.600816:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809587.600820:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 557 00000004:00200000:1.0:1780809587.600848:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809587.600853:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809587.600866:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600877:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600886:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600892:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600898:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600904:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.600909:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600916:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600925:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809587.600928:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.600932:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600961:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600972:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600978:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600985:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.600990:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.600993:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.601002:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.601009:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809587.601012:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.601015:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.601019:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.601037:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 32 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.601053:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 31 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.601058:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809587.601059:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809587.601061:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65600, rc 0) 00000100:00100000:1.0:1780809587.601086:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:142541:x1867312334988672:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3003us (3140us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809587.601109:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7510 00000100:00100000:0.0:1780809587.602229:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809587.602268:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334989312 00000100:00100000:3.0:1780809587.602272:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334989312 00000100:00100000:3.0:1780809587.602301:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7511 00000100:00100000:3.0:1780809587.602309:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:142541:x1867312334989312:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809587.602320:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809587.602329:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f39d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687226d expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.602378:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.602389:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 32 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.602396:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.602414:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 32 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.602424:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 32 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809587.602434:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338747520:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809587.602479:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd09a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809587.603066:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338747520:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809587.603080:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809587.603195:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.603227:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334989440 00000100:00100000:1.0:1780809587.603232:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334989440 00010000:00010000:1.0:1780809587.603248:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 33 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.603273:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 558 00000100:00100000:1.0:1780809587.603282:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2393:x1867312334989440:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809587.603290:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809587.603296:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 33 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.603308:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 33 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.603320:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39cd lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872266 expref: 33 pid: 80225 timeout: 1949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.603336:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809587.603338:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.603343:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.603347:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.603360:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809587.603383:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:2393:x1867312334989440:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 101us (186us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809587.603384:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.603398:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809587.603398:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 558 00000004:00200000:3.0:1780809587.603411:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809587.603476:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f39d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.603488:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 32 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.603496:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809587.603498:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809587.603500:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809587.603523:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:142541:x1867312334989312:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1215us (1293us total) trans 55834578638 rc 0/0 00000100:00100000:3.0:1780809587.603531:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7511 00000100:00100000:0.0:1780809587.620057:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.620105:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334989696 00000100:00100000:1.0:1780809587.620114:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334989696 00000100:00100000:1.0:1780809587.620156:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7512 00000100:00100000:1.0:1780809587.620163:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:142548:x1867312334989696:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809587.620181:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809587.620196:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872274 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620251:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620262:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620282:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620291:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620295:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620299:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620544:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39fe lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620551:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39fe lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620555:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39fe lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809587.620561:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809587.620667:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620674:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620681:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620686:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.620696:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620704:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620715:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809587.620718:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.620723:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620728:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f39f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620740:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620746:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620751:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620756:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809587.620759:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620764:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620769:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809587.620770:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809587.620777:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620780:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f39f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620808:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f39e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872274 expref: 35 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620817:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39fe lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872274 expref: 34 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809587.620821:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809587.620822:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809587.620824:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64600, rc 0) 00000100:00100000:1.0:1780809587.620868:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:142548:x1867312334989696:12345-192.168.203.33@tcp:101:dd.0 Request processed in 704us (815us total) trans 55834578639 rc 0/0 00000100:00100000:1.0:1780809587.620875:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7512 00000100:00100000:0.0:1780809587.621827:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.621871:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334989824 00000100:00100000:2.0:1780809587.621876:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334989824 00000100:00100000:2.0:1780809587.621917:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2151 00000100:00100000:2.0:1780809587.621928:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2392:x1867312334989824:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809587.621937:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809587.621963:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f39fe lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872274 expref: 34 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.621972:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.621974:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809587.621996:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2392:x1867312334989824:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809587.622001:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2151 00000100:00100000:0.0:1780809587.728577:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809587.728631:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334990080 00000100:00100000:3.0:1780809587.728640:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334990080 00000100:00100000:3.0:1780809587.728683:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7513 00000100:00100000:3.0:1780809587.728690:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:142554:x1867312334990080:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809587.728720:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809587.728744:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687227b expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.728799:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.728810:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.728818:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.728827:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.728831:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.728835:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729155:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3a21 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729162:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3a21 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729166:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3a21 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809587.729173:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809587.729242:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729247:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729252:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729255:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809587.729258:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729263:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729271:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809587.729273:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809587.729276:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729280:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729287:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729291:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729294:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729303:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809587.729305:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729308:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729312:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809587.729314:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809587.729315:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729318:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729344:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687227b expref: 36 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729352:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3a21 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687227b expref: 35 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809587.729356:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809587.729357:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809587.729358:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809587.729398:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:142554:x1867312334990080:12345-192.168.203.33@tcp:101:dd.0 Request processed in 710us (829us total) trans 55834578640 rc 0/0 00000100:00100000:3.0:1780809587.729403:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7513 00000100:00100000:0.0:1780809587.730530:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809587.730579:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809587.730610:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334990208 00000100:00100000:2.0:1780809587.730616:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334990208 00000100:00100000:3.0:1780809587.730637:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334990464 00000100:00100000:3.0:1780809587.730649:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334990464 00000100:00100000:2.0:1780809587.730668:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2152 00000100:00100000:2.0:1780809587.730682:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2394:x1867312334990208:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809587.730691:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1806 00010000:00010000:2.0:1780809587.730693:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809587.730704:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:142554:x1867312334990464:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809587.730710:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3a21 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687227b expref: 36 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809587.730740:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809587.730744:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809587.730777:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2394:x1867312334990208:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 100us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809587.730784:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2152 00000100:00100000:3.0:1780809587.730811:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:142554:x1867312334990464:12345-192.168.203.33@tcp:35:dd.0 Request processed in 110us (230us total) trans 55834578641 rc 0/0 00000100:00100000:3.0:1780809587.730820:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1806 00000100:00100000:0.0:1780809587.910071:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809587.910128:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334990720 00000100:00100000:1.0:1780809587.910142:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334990720 00000100:00100000:1.0:1780809587.910190:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1807 00000100:00100000:1.0:1780809587.910198:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:142548:x1867312334990720:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809587.910370:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:142548:x1867312334990720:12345-192.168.203.33@tcp:35:dd.0 Request processed in 173us (305us total) trans 55834578642 rc 0/0 00000100:00100000:1.0:1780809587.910376:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1807 00000100:00100000:0.0:1780809588.034178:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.034235:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334990976 00000100:00100000:2.0:1780809588.034244:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334990976 00000100:00080000:3.0:1780809588.034296:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780809588.034310:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7514 00000100:00100000:2.0:1780809588.034322:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:142569:x1867312334990976:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809588.034343:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809588.034359:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3a2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872282 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034419:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034432:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034444:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034457:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034464:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034486:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034843:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3a44 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034853:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3a44 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034862:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3a44 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809588.034871:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809588.034966:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034975:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034981:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034987:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809588.034991:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.034999:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035010:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809588.035013:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809588.035023:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035030:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3a36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035053:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035060:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035066:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035071:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809588.035074:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035080:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035088:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:2.0:1780809588.035091:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809588.035094:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035100:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3a3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035140:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3a2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872282 expref: 39 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035167:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3a44 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872282 expref: 38 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.035175:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.035177:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809588.035180:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:2.0:1780809588.035227:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142569:x1867312334990976:12345-192.168.203.33@tcp:101:dd.0 Request processed in 908us (1056us total) trans 55834578643 rc 0/0 00000100:00100000:2.0:1780809588.035235:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7514 00000100:00100000:0.0:1780809588.036133:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809588.036185:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334991104 00000100:00100000:1.0:1780809588.036190:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334991104 00000100:00100000:1.0:1780809588.036224:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2153 00000100:00100000:1.0:1780809588.036230:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf63cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2393:x1867312334991104:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809588.036246:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809588.036257:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3a44 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872282 expref: 38 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.036270:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809588.036273:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809588.036296:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf63cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2393:x1867312334991104:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809588.036301:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2153 00000100:00100000:0.0:1780809588.131199:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.131256:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334991232 00000100:00100000:3.0:1780809588.131264:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334991232 00000100:00100000:3.0:1780809588.131303:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7515 00000100:00100000:3.0:1780809588.131310:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:142575:x1867312334991232:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809588.131328:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809588.131344:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3a52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872289 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131388:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131399:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131407:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131415:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131419:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131436:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131701:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131712:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 38 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131721:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131745:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 38 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.131755:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 38 pid: 79214 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809588.131764:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338747648:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809588.131822:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd09a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1780809588.132464:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338747648:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809588.132480:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809588.132606:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.132648:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334991488 00000100:00100000:3.0:1780809588.132651:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334991488 00000100:00100000:3.0:1780809588.132681:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1808 00000100:00100000:3.0:1780809588.132689:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:90168:x1867312334991488:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809588.132834:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:90168:x1867312334991488:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 147us (230us total) trans 55834578644 rc 0/0 00000100:00100000:3.0:1780809588.132840:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1808 00000100:00100000:0.0:1780809588.133421:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.133458:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334991616 00000100:00100000:2.0:1780809588.133462:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334991616 00010000:00010000:2.0:1780809588.133478:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 40 pid: 79214 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.133497:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 559 00000100:00100000:2.0:1780809588.133502:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2394:x1867312334991616:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809588.133508:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809588.133512:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 40 pid: 79214 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.133520:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 40 pid: 79214 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.133533:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f39db lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687226d expref: 40 pid: 79214 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.133550:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.133553:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.133558:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.133561:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.133575:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809588.133607:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133624:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.133637:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2394:x1867312334991616:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 134us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809588.133645:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 559 00000004:00200000:3.0:1780809588.133648:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809588.133652:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809588.133665:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133674:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133683:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133690:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133697:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133701:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.133703:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133709:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133720:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809588.133722:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.133725:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133728:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133735:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133738:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133742:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133746:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.133747:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133750:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133754:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809588.133755:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.133756:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133759:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133784:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3a52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 39 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133792:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 38 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.133796:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.133797:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809588.133799:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809588.133820:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142575:x1867312334991232:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2511us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809588.133824:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7515 00000100:00100000:0.0:1780809588.135129:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809588.135179:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334991872 00000100:00100000:1.0:1780809588.135184:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334991872 00000100:00100000:1.0:1780809588.135217:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7516 00000100:00100000:1.0:1780809588.135226:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142575:x1867312334991872:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809588.135237:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809588.135246:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3a6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872290 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.135285:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.135292:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 39 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.135297:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.135310:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 39 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.135326:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 39 pid: 77628 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809588.135332:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338747776:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809588.135372:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc65ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1780809588.135927:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338747776:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809588.135936:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809588.136148:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.136186:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334992000 00000100:00100000:2.0:1780809588.136191:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334992000 00010000:00010000:2.0:1780809588.136208:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 40 pid: 77628 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.136235:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 560 00000100:00100000:2.0:1780809588.136243:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2393:x1867312334992000:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809588.136251:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809588.136257:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 40 pid: 77628 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.136267:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 40 pid: 77628 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.136285:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3a67 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872289 expref: 40 pid: 77628 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.136293:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.136296:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.136300:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.136304:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.136317:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809588.136337:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2393:x1867312334992000:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 96us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809588.136341:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.136342:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 560 00010000:00010000:1.0:1780809588.136350:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809588.136358:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809588.136418:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 40 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.136428:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 39 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.136435:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809588.136438:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809588.136441:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65000, rc 0) 00000100:00100000:1.0:1780809588.136477:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142575:x1867312334991872:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1251us (1347us total) trans 55834578645 rc 0/0 00000100:00100000:1.0:1780809588.136491:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7516 00000100:00100000:0.0:1780809588.179028:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.179091:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334992256 00000100:00100000:3.0:1780809588.179100:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334992256 00000100:00100000:3.0:1780809588.179153:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7517 00000100:00100000:3.0:1780809588.179163:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142582:x1867312334992256:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809588.179185:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809588.179203:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872297 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179268:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179281:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179292:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179318:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179325:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179332:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179698:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3a98 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179708:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3a98 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179715:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3a98 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809588.179725:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809588.179805:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179813:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179819:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179825:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.179828:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179844:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179866:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809588.179869:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.179874:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179879:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3a8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179891:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179897:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179902:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179907:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.179910:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179915:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179922:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809588.179924:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.179927:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179958:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3a91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.179997:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872297 expref: 42 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.180010:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3a98 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872297 expref: 41 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.180017:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.180019:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809588.180021:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809588.180072:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142582:x1867312334992256:12345-192.168.203.33@tcp:101:dd.0 Request processed in 910us (1049us total) trans 55834578646 rc 0/0 00000100:00100000:3.0:1780809588.180080:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7517 00000100:00100000:2.0:1780809588.181134:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.181166:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809588.181169:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334992384 00000100:00100000:1.0:1780809588.181174:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334992384 00000100:00100000:3.0:1780809588.181210:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334992640 00000100:00100000:3.0:1780809588.181216:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334992640 00000100:00100000:1.0:1780809588.181224:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2154 00000100:00100000:1.0:1780809588.181233:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2394:x1867312334992384:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809588.181240:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809588.181256:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1809 00000100:00100000:3.0:1780809588.181266:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:142582:x1867312334992640:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809588.181299:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3a98 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872297 expref: 42 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.181312:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809588.181315:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809588.181338:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2394:x1867312334992384:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809588.181344:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2154 00000100:00100000:3.0:1780809588.181383:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142582:x1867312334992640:12345-192.168.203.33@tcp:35:dd.0 Request processed in 118us (216us total) trans 55834578647 rc 0/0 00000100:00100000:3.0:1780809588.181392:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1809 00010000:00010000:1.0:1780809588.275776:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809588.337666:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.337729:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334992896 00000100:00100000:3.0:1780809588.337740:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334992896 00000100:00100000:3.0:1780809588.337792:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1810 00000100:00100000:3.0:1780809588.337801:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf6a90c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142569:x1867312334992896:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809588.337998:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf6a90c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:142569:x1867312334992896:12345-192.168.203.33@tcp:35:dd.0 Request processed in 198us (338us total) trans 55834578648 rc 0/0 00000100:00100000:3.0:1780809588.338003:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1810 00000100:00100000:0.0:1780809588.459733:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809588.459784:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334993024 00000100:00100000:1.0:1780809588.459793:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334993024 00000100:00100000:1.0:1780809588.459848:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7518 00000100:00100000:1.0:1780809588.459860:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:142590:x1867312334993024:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809588.459884:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809588.459902:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3aa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687229e expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.459973:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.459987:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460009:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460023:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460029:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460035:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460339:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460348:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 43 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460354:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460384:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 43 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.460398:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 43 pid: 80225 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809588.460410:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338747904:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809588.460468:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd03b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780809588.461227:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338747904:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809588.461239:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809588.461538:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.461579:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334993280 00000100:00100000:3.0:1780809588.461584:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334993280 00000100:00100000:3.0:1780809588.461637:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1811 00000100:00100000:3.0:1780809588.461642:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:90168:x1867312334993280:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809588.461775:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:90168:x1867312334993280:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 132us (238us total) trans 55834578649 rc 0/0 00000100:00100000:3.0:1780809588.461780:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1811 00000100:00100000:2.0:1780809588.462411:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809588.462450:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334993408 00000100:00100000:1.0:1780809588.462455:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334993408 00010000:00010000:1.0:1780809588.462473:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 45 pid: 80225 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809588.462495:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 561 00000100:00100000:1.0:1780809588.462500:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2393:x1867312334993408:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809588.462507:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809588.462515:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 45 pid: 80225 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.462524:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 45 pid: 80225 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.462537:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3a75 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872290 expref: 45 pid: 80225 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.462546:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809588.462549:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.462554:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.462558:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.462578:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809588.462604:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462611:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809588.462630:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2393:x1867312334993408:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 128us (217us total) trans 0 rc 0/0 00000004:00200000:3.0:1780809588.462633:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809588.462637:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1780809588.462638:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 561 00000004:00010000:3.0:1780809588.462649:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462658:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462664:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462668:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462681:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462685:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.462688:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462692:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462699:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809588.462701:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.462703:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462709:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f3aad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462719:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462726:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462731:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462736:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.462739:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462755:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462764:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:3.0:1780809588.462766:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.462768:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462772:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f3ab4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462794:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3aa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462801:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 43 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.462806:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.462807:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809588.462809:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65c00, rc 0) 00000100:00100000:3.0:1780809588.462832:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142590:x1867312334993024:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2977us (3106us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809588.462837:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7518 00000100:00100000:2.0:1780809588.464229:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.464266:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334993664 00000100:00100000:3.0:1780809588.464271:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334993664 00000100:00100000:3.0:1780809588.464301:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7519 00000100:00100000:3.0:1780809588.464310:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142590:x1867312334993664:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809588.464330:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809588.464340:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3ac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722a5 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.464389:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.464400:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.464407:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.464427:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.464439:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 44 pid: 77629 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809588.464449:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338748032:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809588.464481:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd09a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1780809588.465116:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338748032:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809588.465128:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.465353:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809588.465436:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334993792 00000100:00100000:0.0:1780809588.465441:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334993792 00010000:00010000:0.0:1780809588.465460:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 45 pid: 77629 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809588.465490:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 562 00000100:00100000:0.0:1780809588.465496:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2394:x1867312334993792:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809588.465503:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809588.465506:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 45 pid: 77629 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.465515:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 45 pid: 77629 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.465524:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f3abb lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687229e expref: 45 pid: 77629 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.465541:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809588.465544:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.465549:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.465553:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.465566:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809588.465584:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.465607:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809588.465608:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2394:x1867312334993792:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 92us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809588.465617:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 562 00000004:00200000:3.0:1780809588.465624:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809588.465694:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3ac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 45 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.465708:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 44 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.465715:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.465717:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809588.465719:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809588.465747:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142590:x1867312334993664:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1439us (1519us total) trans 55834578650 rc 0/0 00000100:00100000:3.0:1780809588.465753:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7519 00000100:00100000:2.0:1780809588.524458:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809588.524507:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334994048 00000100:00100000:0.0:1780809588.524515:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334994048 00000100:00100000:0.0:1780809588.524556:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7520 00000100:00100000:0.0:1780809588.524562:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142597:x1867312334994048:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809588.524579:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809588.524616:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722ac expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.524669:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.524679:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.524699:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.524711:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.524718:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.524724:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525001:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3aec lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525011:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3aec lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525019:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3aec lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809588.525028:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809588.525091:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525096:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525101:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525104:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809588.525120:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525132:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525143:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809588.525147:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809588.525152:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525158:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525175:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525178:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525182:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525185:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809588.525186:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525190:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525194:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809588.525195:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809588.525201:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525205:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525235:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722ac expref: 47 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525243:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3aec lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722ac expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809588.525248:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809588.525249:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809588.525251:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cec00, rc 0) 00000100:00100000:0.0:1780809588.525293:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:142597:x1867312334994048:12345-192.168.203.33@tcp:101:dd.0 Request processed in 731us (843us total) trans 55834578651 rc 0/0 00000100:00100000:0.0:1780809588.525297:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7520 00000100:00100000:0.0:1780809588.526159:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809588.526204:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334994176 00000100:00100000:1.0:1780809588.526209:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334994176 00000100:00100000:1.0:1780809588.526241:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2155 00000100:00100000:1.0:1780809588.526247:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2393:x1867312334994176:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809588.526254:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809588.526264:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3aec lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722ac expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.526275:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809588.526277:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809588.526299:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2393:x1867312334994176:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 53us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809588.526303:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2155 00000100:00100000:1.0:1780809588.595719:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780809588.595735:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338748160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780809588.595788:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809588.595830:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338748160 00000100:00100000:3.0:1780809588.595839:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338748160 00000100:00100000:3.0:1780809588.595887:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1780809588.595898:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338748160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780809588.595935:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1780809588.596007:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338748160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809588.596015:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1780809588.596033:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacda8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338748160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780809588.663631:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.663695:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334994432 00000100:00100000:3.0:1780809588.663705:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334994432 00000100:00100000:3.0:1780809588.663764:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7521 00000100:00100000:3.0:1780809588.663775:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:142603:x1867312334994432:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809588.663798:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809588.663830:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722b3 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.663899:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.663914:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.663926:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.663952:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.663960:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.663967:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664294:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b0f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664304:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b0f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664312:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b0f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809588.664322:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809588.664406:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664425:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664432:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664438:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.664442:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664450:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664462:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809588.664466:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.664470:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664476:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664489:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664495:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664500:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664505:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.664515:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664522:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664530:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809588.664533:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.664536:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664542:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664580:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722b3 expref: 48 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664634:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b0f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722b3 expref: 47 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.664642:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.664644:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809588.664647:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809588.664701:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142603:x1867312334994432:12345-192.168.203.33@tcp:101:dd.0 Request processed in 928us (1076us total) trans 55834578652 rc 0/0 00000100:00100000:3.0:1780809588.664708:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7521 00000100:00100000:2.0:1780809588.665785:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.665816:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334994816 00000100:00100000:3.0:1780809588.665822:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334994816 00000100:00100000:3.0:1780809588.665855:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1812 00000100:00100000:3.0:1780809588.665863:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142603:x1867312334994816:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809588.665908:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.665955:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334994560 00000100:00100000:2.0:1780809588.665959:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334994560 00000100:00100000:3.0:1780809588.665998:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142603:x1867312334994816:12345-192.168.203.33@tcp:35:dd.0 Request processed in 133us (210us total) trans 55834578653 rc 0/0 00000100:00100000:2.0:1780809588.666006:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2156 00000100:00100000:3.0:1780809588.666011:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1812 00000100:00100000:2.0:1780809588.666021:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf63cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2394:x1867312334994560:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809588.666032:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809588.666046:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b0f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722b3 expref: 48 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.666060:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.666064:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809588.666086:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf63cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2394:x1867312334994560:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809588.666091:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2156 00000100:00100000:2.0:1780809588.807497:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809588.807575:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334995072 00000100:00100000:1.0:1780809588.807584:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334995072 00000100:00100000:1.0:1780809588.807644:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7522 00000100:00100000:1.0:1780809588.807651:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142610:x1867312334995072:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809588.807684:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809588.807703:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722ba expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.807764:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.807776:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.807786:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.807796:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.807800:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.807804:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808072:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3b32 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808079:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3b32 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808083:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3b32 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809588.808090:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809588.808162:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808173:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808180:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808184:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809588.808187:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808192:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808200:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809588.808202:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809588.808205:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808208:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f3b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808217:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808220:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808224:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808233:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809588.808235:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808238:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808242:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:1.0:1780809588.808243:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809588.808245:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808248:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f3b2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808276:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f3b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722ba expref: 50 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808284:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3b32 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722ba expref: 49 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809588.808288:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809588.808290:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809588.808291:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65600, rc 0) 00000100:00100000:1.0:1780809588.808333:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142610:x1867312334995072:12345-192.168.203.33@tcp:101:dd.0 Request processed in 683us (843us total) trans 55834578654 rc 0/0 00000100:00100000:1.0:1780809588.808338:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7522 00000100:00100000:0.0:1780809588.809283:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.809324:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334995200 00000100:00100000:2.0:1780809588.809328:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334995200 00000100:00100000:0.0:1780809588.809334:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.809362:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2157 00000100:00100000:2.0:1780809588.809369:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2393:x1867312334995200:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809588.809374:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334995456 00010000:00010000:2.0:1780809588.809377:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809588.809380:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334995456 00010000:00010000:2.0:1780809588.809388:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f3b32 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722ba expref: 50 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.809400:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.809403:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809588.809419:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1813 00000100:00100000:2.0:1780809588.809431:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2393:x1867312334995200:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 60us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809588.809433:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142610:x1867312334995456:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809588.809441:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2157 00000100:00100000:3.0:1780809588.809539:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142610:x1867312334995456:12345-192.168.203.33@tcp:35:dd.0 Request processed in 111us (205us total) trans 55834578655 rc 0/0 00000100:00100000:3.0:1780809588.809547:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1813 00000100:00100000:0.0:1780809588.840998:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.841048:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334995712 00000100:00100000:3.0:1780809588.841056:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334995712 00000100:00100000:3.0:1780809588.841096:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1814 00000100:00100000:3.0:1780809588.841103:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142597:x1867312334995712:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809588.841280:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142597:x1867312334995712:12345-192.168.203.33@tcp:35:dd.0 Request processed in 177us (289us total) trans 55834578656 rc 0/0 00000100:00100000:3.0:1780809588.841288:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1814 00000100:00100000:0.0:1780809588.887905:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.887979:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334995840 00000100:00100000:3.0:1780809588.887989:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334995840 00000100:00100000:3.0:1780809588.888039:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7523 00000100:00100000:3.0:1780809588.888050:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142618:x1867312334995840:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809588.888070:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809588.888088:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722c1 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888162:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888176:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888186:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888199:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888205:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888212:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888511:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888523:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888531:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888559:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.888583:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 51 pid: 77627 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809588.888622:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338748288:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809588.888694:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd09a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809588.889687:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338748288:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809588.889705:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809588.889775:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.889813:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334996096 00000100:00100000:3.0:1780809588.889818:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334996096 00000100:00100000:3.0:1780809588.889846:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1815 00000100:00100000:3.0:1780809588.889851:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:90168:x1867312334996096:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809588.890008:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:90168:x1867312334996096:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 156us (234us total) trans 55834578657 rc 0/0 00000100:00100000:3.0:1780809588.890013:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1815 00000100:00100000:1.0:1780809588.890631:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.890684:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334996224 00000100:00100000:2.0:1780809588.890694:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334996224 00010000:00010000:2.0:1780809588.890710:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 53 pid: 77627 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.890731:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 563 00000100:00100000:2.0:1780809588.890736:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2394:x1867312334996224:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809588.890743:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809588.890747:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 53 pid: 77627 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.890757:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 53 pid: 77627 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.890769:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3ac9 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722a5 expref: 53 pid: 77627 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.890780:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.890787:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.890792:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.890796:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.890809:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809588.890832:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2394:x1867312334996224:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 95us (202us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809588.890836:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890849:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.890850:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 563 00000004:00200000:3.0:1780809588.890876:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809588.890880:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809588.890889:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890906:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890914:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890918:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890923:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890928:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.890931:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890951:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890960:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809588.890963:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.890967:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890972:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890983:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.890990:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891002:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891007:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.891010:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891016:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891025:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809588.891028:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.891032:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891038:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891066:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 52 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891079:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 51 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.891099:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.891101:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809588.891104:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809588.891135:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:142618:x1867312334995840:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3087us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809588.891153:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7523 00000100:00100000:1.0:1780809588.892502:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.892535:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334996480 00000100:00100000:3.0:1780809588.892540:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334996480 00000100:00100000:3.0:1780809588.892566:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7524 00000100:00100000:3.0:1780809588.892571:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:142618:x1867312334996480:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809588.892582:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809588.892607:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722c8 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.892656:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.892664:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 52 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.892668:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.892684:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 52 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.892692:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 52 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809588.892699:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338748416:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809588.892738:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd09a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1780809588.893494:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.893498:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338748416:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809588.893525:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.893532:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334996608 00000100:00100000:2.0:1780809588.893538:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334996608 00010000:00010000:2.0:1780809588.893558:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 53 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.893580:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 564 00000100:00100000:2.0:1780809588.893614:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2393:x1867312334996608:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809588.893624:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809588.893630:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 53 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.893642:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 53 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.893656:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3b55 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c1 expref: 53 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.893679:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.893683:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.893691:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.893697:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.893729:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809588.893746:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.893754:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809588.893762:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2393:x1867312334996608:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 174us (267us total) trans 0 rc 0/0 00000004:00200000:3.0:1780809588.893763:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809588.893773:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 564 00010000:00010000:3.0:1780809588.893844:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 53 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.893860:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 52 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.893873:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.893876:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809588.893879:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809588.893908:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142618:x1867312334996480:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1336us (1407us total) trans 55834578658 rc 0/0 00000100:00100000:3.0:1780809588.893916:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7524 00000100:00100000:0.0:1780809588.964981:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809588.965038:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334996864 00000100:00100000:3.0:1780809588.965046:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334996864 00000100:00100000:3.0:1780809588.965103:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7525 00000100:00100000:3.0:1780809588.965120:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142632:x1867312334996864:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809588.965144:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809588.965162:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3b71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722cf expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965233:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965246:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965255:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965267:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965273:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965279:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965576:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b86 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965586:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b86 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965616:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b86 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809588.965626:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809588.965707:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965724:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965731:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965737:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.965741:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965748:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965758:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809588.965760:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.965764:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965767:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965775:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965779:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965782:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965785:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809588.965790:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965794:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965798:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809588.965800:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809588.965801:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965804:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3b7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965831:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3b71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722cf expref: 55 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965840:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b86 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722cf expref: 54 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809588.965845:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809588.965846:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809588.965848:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809588.965889:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:142632:x1867312334996864:12345-192.168.203.33@tcp:101:dd.0 Request processed in 779us (918us total) trans 55834578659 rc 0/0 00000100:00100000:3.0:1780809588.965894:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7525 00000100:00100000:0.0:1780809588.966903:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809588.966960:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334996992 00000100:00100000:2.0:1780809588.966966:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334996992 00000100:00100000:2.0:1780809588.967004:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2158 00000100:00100000:2.0:1780809588.967012:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2394:x1867312334996992:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809588.967022:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809588.967041:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3b86 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722cf expref: 54 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809588.967054:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809588.967058:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809588.967086:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2394:x1867312334996992:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809588.967092:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2158 00000100:00100000:1.0:1780809589.063655:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809589.063709:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334997248 00000100:00100000:0.0:1780809589.063720:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334997248 00000100:00100000:0.0:1780809589.063783:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7526 00000100:00100000:0.0:1780809589.063791:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:142638:x1867312334997248:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809589.063809:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809589.063823:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722d6 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.063874:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.063885:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.063892:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.063901:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.063905:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.063909:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064175:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3ba9 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064181:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3ba9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064186:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3ba9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809589.064200:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809589.064265:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064270:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064274:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064277:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809589.064280:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064284:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064292:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809589.064294:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809589.064297:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064300:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3b9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064312:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064315:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064325:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064329:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809589.064330:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064333:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064337:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809589.064339:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809589.064340:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064343:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3ba2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064369:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722d6 expref: 56 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064378:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3ba9 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722d6 expref: 55 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.064385:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809589.064387:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809589.064389:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cec00, rc 0) 00000100:00100000:0.0:1780809589.064442:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142638:x1867312334997248:12345-192.168.203.33@tcp:101:dd.0 Request processed in 651us (795us total) trans 55834578660 rc 0/0 00000100:00100000:0.0:1780809589.064458:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7526 00000100:00100000:0.0:1780809589.065965:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809589.066004:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.066015:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334997376 00000100:00100000:2.0:1780809589.066021:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334997376 00000100:00100000:3.0:1780809589.066043:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334997632 00000100:00100000:3.0:1780809589.066048:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334997632 00000100:00100000:2.0:1780809589.066059:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2159 00000100:00100000:2.0:1780809589.066070:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2393:x1867312334997376:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809589.066079:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1816 00010000:00010000:2.0:1780809589.066083:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809589.066090:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5049850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142638:x1867312334997632:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809589.066097:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f3ba9 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722d6 expref: 56 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.066119:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.066122:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809589.066148:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2393:x1867312334997376:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.066154:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2159 00000100:00100000:3.0:1780809589.066215:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5049850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142638:x1867312334997632:12345-192.168.203.33@tcp:35:dd.0 Request processed in 128us (210us total) trans 55834578661 rc 0/0 00000100:00100000:3.0:1780809589.066222:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1816 00000100:00100000:1.0:1780809589.257974:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809589.258047:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334997888 00000100:00100000:3.0:1780809589.258057:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334997888 00000100:00100000:3.0:1780809589.258109:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1817 00000100:00100000:3.0:1780809589.258120:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142632:x1867312334997888:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809589.258340:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142632:x1867312334997888:12345-192.168.203.33@tcp:35:dd.0 Request processed in 221us (370us total) trans 55834578662 rc 0/0 00000100:00100000:3.0:1780809589.258348:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1817 00010000:00010000:1.0:1780809589.299706:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809589.382200:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809589.382257:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334998144 00000100:00100000:3.0:1780809589.382265:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334998144 00000100:00100000:3.0:1780809589.382307:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7527 00000100:00100000:3.0:1780809589.382314:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142646:x1867312334998144:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809589.382332:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809589.382347:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722dd expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382398:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382409:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382416:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382438:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382443:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382447:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382714:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3bcc lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382720:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3bcc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382724:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3bcc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809589.382731:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809589.382792:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382797:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382801:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382804:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809589.382807:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382826:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382837:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809589.382840:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809589.382845:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382850:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382862:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382875:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382880:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382885:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809589.382887:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382892:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382898:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809589.382900:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809589.382903:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382917:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3bc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382963:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722dd expref: 59 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382976:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3bcc lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722dd expref: 58 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.382983:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809589.382985:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809589.382988:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809589.383033:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:142646:x1867312334998144:12345-192.168.203.33@tcp:101:dd.0 Request processed in 720us (842us total) trans 55834578663 rc 0/0 00000100:00100000:3.0:1780809589.383038:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7527 00000100:00100000:0.0:1780809589.384088:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.384133:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334998272 00000100:00100000:2.0:1780809589.384138:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334998272 00000100:00100000:2.0:1780809589.384167:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2160 00000100:00100000:2.0:1780809589.384173:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2394:x1867312334998272:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809589.384180:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809589.384191:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3bcc lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722dd expref: 58 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.384201:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.384204:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809589.384228:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2394:x1867312334998272:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.384232:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2160 00000100:00100000:1.0:1780809589.426918:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809589.426969:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334998528 00000100:00100000:0.0:1780809589.426978:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334998528 00000100:00100000:0.0:1780809589.427031:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7528 00000100:00100000:0.0:1780809589.427040:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142652:x1867312334998528:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809589.427062:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809589.427080:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3bda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722e4 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427143:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427157:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427168:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427181:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427188:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427194:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427473:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f3bef lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427482:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f3bef lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427490:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f3bef lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809589.427499:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809589.427572:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427578:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427582:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427586:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809589.427610:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427615:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427624:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809589.427626:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809589.427629:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427639:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3be1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427652:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427656:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427659:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427662:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809589.427664:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427667:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427671:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809589.427672:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809589.427674:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427677:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3be8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427705:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3bda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722e4 expref: 60 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427722:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f3bef lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722e4 expref: 59 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.427727:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809589.427729:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809589.427730:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce800, rc 0) 00000100:00100000:0.0:1780809589.427773:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142652:x1867312334998528:12345-192.168.203.33@tcp:101:dd.0 Request processed in 735us (861us total) trans 55834578664 rc 0/0 00000100:00100000:0.0:1780809589.427777:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7528 00000100:00100000:1.0:1780809589.428845:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809589.428867:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.428881:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334998656 00000100:00100000:2.0:1780809589.428886:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334998656 00000100:00100000:3.0:1780809589.428917:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334998912 00000100:00100000:3.0:1780809589.428923:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334998912 00000100:00100000:2.0:1780809589.428925:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2161 00000100:00100000:2.0:1780809589.428949:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf63ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2393:x1867312334998656:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809589.428960:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809589.428974:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1818 00010000:00010000:2.0:1780809589.428980:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f3bef lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722e4 expref: 60 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809589.428988:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:142652:x1867312334998912:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809589.429012:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.429016:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809589.429049:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf63ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2393:x1867312334998656:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 115us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.429058:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2161 00000100:00100000:3.0:1780809589.429130:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142652:x1867312334998912:12345-192.168.203.33@tcp:35:dd.0 Request processed in 146us (260us total) trans 55834578665 rc 0/0 00000100:00100000:3.0:1780809589.429139:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1818 00000100:00100000:1.0:1780809589.619756:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780809589.619778:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338748928:0@lo:400:kworker.0 00000100:00100000:3.0:1780809589.619785:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338748800:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.619847:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338749056:0@lo:400:kworker.0 00000100:00100000:3.0:1780809589.619852:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809589.619853:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.619891:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809589.619910:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cae01ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338748544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809589.619911:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338749312:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.619918:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338749568:0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.619963:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.619963:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809589.619976:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.619989:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338750080:0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620000:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338749440:0@lo:400:kworker.0 00000100:00100000:3.0:1780809589.620010:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338749824:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620018:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809589.620052:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338748672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780809589.620054:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338748800 00000100:00100000:3.0:1780809589.620060:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809589.620062:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338748800 00000100:00100000:0.0:1780809589.620077:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749056 00000100:00100000:0.0:1780809589.620081:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749056 00000100:00100000:3.0:1780809589.620088:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338750336:0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620091:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809589.620113:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1780809589.620124:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf4fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338748800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620131:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338749184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780809589.620133:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.620134:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749312 00000100:00100000:0.0:1780809589.620140:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749312 00000100:00100000:0.0:1780809589.620180:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749824 00000100:00100000:0.0:1780809589.620183:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749824 00000100:00100000:3.0:1780809589.620197:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1780809589.620201:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf4fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338748800:12345-0@lo:400:kworker.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809589.620214:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338749056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620214:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1780809589.620215:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.620220:0:78803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1780809589.620230:0:78803:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338749312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620265:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338748928 00000100:00100000:2.0:1780809589.620267:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338748544 00000100:00100000:1.0:1780809589.620270:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338748928 00000100:00100000:2.0:1780809589.620272:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338748544 00000100:00100000:0.0:1780809589.620276:0:78803:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338749312:12345-0@lo:400:kworker.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809589.620278:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338749056:12345-0@lo:400:kworker.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809589.620289:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1780809589.620296:0:78803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1780809589.620307:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749568 00000100:00100000:2.0:1780809589.620310:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338748672 00000100:00100000:1.0:1780809589.620312:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749568 00000100:00100000:2.0:1780809589.620314:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338748672 00000100:00100000:3.0:1780809589.620317:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1780809589.620327:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3443:x1867312338749824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620337:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1780809589.620345:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749184 00000100:00100000:0.0:1780809589.620349:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338748928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620350:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749184 00000100:00100000:1.0:1780809589.620350:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1780809589.620366:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338749568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809589.620367:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3443:x1867312338749824:12345-0@lo:400:kworker.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.620372:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1780809589.620384:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1780809589.620385:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338748544:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780809589.620396:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338748928:12345-0@lo:400:kworker.0 Request processed in 51us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809589.620401:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00002000:00000024:2.0:1780809589.620416:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00080000:0.0:1780809589.620423:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780809589.620427:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780809589.620428:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338749568:12345-0@lo:400:kworker.0 Request processed in 66us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809589.620437:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1780809589.620460:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338749056:0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620461:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338748544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809589.620463:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338749696:0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620470:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1780809589.620474:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338749568:0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620479:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1780809589.620484:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338748672:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809589.620500:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1780809589.620505:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.620505:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338750080 00002000:00000024:1.0:1780809589.620507:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:0.0:1780809589.620510:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338750080 00000100:00100000:2.0:1780809589.620513:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338749184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780809589.620524:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:3.0:1780809589.620529:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338750208:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620541:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338750336 00000100:00100000:0.0:1780809589.620544:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338750336 00000100:00100000:1.0:1780809589.620553:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338748672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.620560:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338749184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809589.620563:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1780809589.620569:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1780809589.620570:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809589.620582:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1780809589.620583:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338750080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620623:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809589.620625:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749696 00000100:00100000:2.0:1780809589.620629:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749696 00000100:00100000:3.0:1780809589.620642:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338748672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780809589.620643:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338750080:12345-0@lo:400:kworker.0 Request processed in 61us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809589.620652:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338749952:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620657:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1780809589.620658:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1780809589.620666:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338749184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780809589.620669:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338749696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620675:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338750208 00000100:00100000:0.0:1780809589.620679:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338750208 00000100:00100000:1.0:1780809589.620687:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.620702:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749440 00000100:00100000:0.0:1780809589.620705:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749440 00000100:00100000:1.0:1780809589.620706:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338750464:0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620721:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338749696:12345-0@lo:400:kworker.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809589.620721:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338749952 00000100:00100000:0.0:1780809589.620724:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338749952 00000100:00100000:2.0:1780809589.620734:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1780809589.620743:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1780809589.620746:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809589.620753:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338750336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620769:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338748928:0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620788:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338750464 00000100:00100000:1.0:1780809589.620790:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cae01ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338748544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809589.620792:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338750464 00000100:00100000:0.0:1780809589.620795:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338750336:12345-0@lo:400:kworker.0 Request processed in 43us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809589.620804:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1780809589.620823:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1780809589.620828:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1780809589.620835:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338750208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620841:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338749440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620845:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338749824:0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620860:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338750336:0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620876:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338748800:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620882:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338750208:12345-0@lo:400:kworker.0 Request processed in 51us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809589.620887:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1780809589.620891:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338749312:0@lo:400:kworker.0 00000100:00100000:2.0:1780809589.620895:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338749440:12345-0@lo:400:kworker.0 Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.620901:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1780809589.620906:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1780809589.620915:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338749952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.620957:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338749440:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620963:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338749952:12345-0@lo:400:kworker.0 Request processed in 48us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.620968:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1780809589.620976:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338749952:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.620976:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1780809589.620996:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338750464:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1780809589.620997:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780809589.621004:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809589.621026:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338749696:0@lo:400:kworker.0 00000100:00100000:0.0:1780809589.621031:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338750080:0@lo:400:kworker.0 00010000:00080000:3.0:1780809589.621048:0:3442:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadfce95500 x1867312338750208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809589.621048:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338750464:12345-0@lo:400:kworker.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.621054:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00010000:00080000:1.0:1780809589.621060:0:3444:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadfce96d80 x1867312338750464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780809589.621072:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338750464:0@lo:400:kworker.0 00000100:00100000:3.0:1780809589.621089:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfce95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338750208:0@lo:400:kworker.0 00000100:00100000:1.0:1780809589.675390:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809589.675432:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334999168 00000100:00100000:0.0:1780809589.675440:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334999168 00000100:00100000:0.0:1780809589.675482:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7529 00000100:00100000:0.0:1780809589.675489:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142659:x1867312334999168:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809589.675507:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809589.675522:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722eb expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675576:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675618:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675626:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675637:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675641:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675645:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675972:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f3c12 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675980:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f3c12 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.675984:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f3c12 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809589.675991:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809589.676064:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676069:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676073:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676082:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809589.676085:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676089:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676097:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809589.676099:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809589.676103:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676107:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676120:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676123:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676126:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676129:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809589.676131:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676134:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676144:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809589.676145:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809589.676147:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676150:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676178:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722eb expref: 62 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676186:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f3c12 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722eb expref: 61 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.676190:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809589.676192:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809589.676193:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf800, rc 0) 00000100:00100000:0.0:1780809589.676248:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:142659:x1867312334999168:12345-192.168.203.33@tcp:101:dd.0 Request processed in 758us (865us total) trans 55834578666 rc 0/0 00000100:00100000:0.0:1780809589.676254:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7529 00000100:00100000:0.0:1780809589.677277:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809589.677320:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.677324:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334999296 00000100:00100000:2.0:1780809589.677329:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334999296 00000100:00100000:3.0:1780809589.677368:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334999552 00000100:00100000:2.0:1780809589.677369:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2162 00000100:00100000:3.0:1780809589.677372:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334999552 00000100:00100000:2.0:1780809589.677383:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:2394:x1867312334999296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809589.677393:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809589.677401:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1819 00000100:00100000:3.0:1780809589.677408:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142659:x1867312334999552:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809589.677413:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f3c12 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722eb expref: 62 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.677426:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.677430:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809589.677459:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2394:x1867312334999296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.677466:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2162 00000100:00100000:3.0:1780809589.677519:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:142659:x1867312334999552:12345-192.168.203.33@tcp:35:dd.0 Request processed in 111us (199us total) trans 55834578667 rc 0/0 00000100:00100000:3.0:1780809589.677525:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1819 00000100:00100000:1.0:1780809589.722140:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809589.722196:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334999680 00000100:00100000:3.0:1780809589.722205:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334999680 00000100:00100000:3.0:1780809589.722246:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7530 00000100:00100000:3.0:1780809589.722253:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfcec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:142666:x1867312334999680:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809589.722272:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809589.722288:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722f2 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722335:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722345:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722354:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722362:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722380:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722385:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722662:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722674:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 62 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722682:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722711:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 62 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.722721:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 62 pid: 77629 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809589.722732:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338750592:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809589.722798:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd09a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1780809589.723536:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338750592:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809589.723555:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809589.723634:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809589.723668:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312334999936 00000100:00100000:3.0:1780809589.723678:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312334999936 00000100:00100000:3.0:1780809589.723700:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1820 00000100:00100000:3.0:1780809589.723705:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:89645:x1867312334999936:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809589.723839:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:89645:x1867312334999936:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 133us (205us total) trans 55834578668 rc 0/0 00000100:00100000:3.0:1780809589.723845:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1820 00000100:00100000:1.0:1780809589.724497:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.724539:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335000064 00000100:00100000:2.0:1780809589.724543:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335000064 00010000:00010000:2.0:1780809589.724558:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 64 pid: 77629 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.724577:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 565 00000100:00100000:2.0:1780809589.724581:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2393:x1867312335000064:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809589.724610:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809589.724615:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 64 pid: 77629 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.724624:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 64 pid: 77629 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.724635:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3b63 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722c8 expref: 64 pid: 77629 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.724645:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.724648:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.724659:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.724663:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.724677:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809589.724698:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2393:x1867312335000064:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 116us (202us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809589.724702:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.724703:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 565 00010000:00010000:3.0:1780809589.724710:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809589.724729:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809589.724732:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809589.724741:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724748:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724754:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724758:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724763:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724768:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809589.724772:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724786:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724796:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809589.724798:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809589.724803:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724809:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724817:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724821:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724825:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724827:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809589.724829:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724832:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724836:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91500) 00010000:00010000:3.0:1780809589.724838:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809589.724840:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724851:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3c2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724872:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 63 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724880:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 62 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.724885:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809589.724886:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809589.724888:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809589.724917:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfcec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142666:x1867312334999680:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2663us (2783us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809589.724924:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7530 00000100:00100000:1.0:1780809589.726082:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809589.726114:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335000320 00000100:00100000:0.0:1780809589.726118:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335000320 00000100:00100000:0.0:1780809589.726138:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7531 00000100:00100000:0.0:1780809589.726142:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142666:x1867312335000320:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809589.726150:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809589.726162:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468722f9 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.726200:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.726207:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 63 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.726212:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.726224:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 63 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.726230:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 63 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809589.726237:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338750720:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809589.726266:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc12ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1780809589.726749:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338750720:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809589.726759:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809589.726948:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.726977:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335000448 00000100:00100000:2.0:1780809589.726981:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335000448 00010000:00010000:2.0:1780809589.726993:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 64 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.727011:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 566 00000100:00100000:2.0:1780809589.727017:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2394:x1867312335000448:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809589.727023:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809589.727026:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 64 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.727035:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 64 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.727043:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3c35 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f2 expref: 64 pid: 79214 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.727057:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.727060:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.727071:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.727075:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.727086:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809589.727106:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2394:x1867312335000448:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 89us (158us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809589.727107:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.727118:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 566 00010000:00010000:3.0:1780809589.727119:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809589.727129:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809589.727187:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f3c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 64 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.727210:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 63 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809589.727215:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809589.727217:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809589.727218:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf600, rc 0) 00000100:00100000:3.0:1780809589.727242:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142666:x1867312335000320:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1099us (1162us total) trans 55834578669 rc 0/0 00000100:00100000:3.0:1780809589.727247:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7531 00000100:00100000:1.0:1780809589.957026:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.957075:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335000576 00000100:00100000:2.0:1780809589.957084:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335000576 00000100:00100000:2.0:1780809589.957135:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7532 00000100:00100000:2.0:1780809589.957147:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142680:x1867312335000576:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809589.957169:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809589.957186:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872300 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957235:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957245:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957266:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957276:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957281:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957285:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957555:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957563:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 64 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957568:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957612:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 64 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.957621:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 64 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.957630:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338750848:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809589.957688:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc414c180 going to sleep for 11 seconds 00000100:00100000:2.0:1780809589.958418:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338750848:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809589.958437:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809589.958641:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809589.958689:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335000832 00000100:00100000:3.0:1780809589.958693:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335000832 00000100:00100000:3.0:1780809589.958726:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1821 00000100:00100000:3.0:1780809589.958731:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:89646:x1867312335000832:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809589.958867:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:89646:x1867312335000832:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 135us (227us total) trans 55834578670 rc 0/0 00000100:00100000:3.0:1780809589.958872:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1821 00000100:00100000:0.0:1780809589.959490:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.959535:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335000960 00000100:00100000:2.0:1780809589.959540:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335000960 00010000:00010000:2.0:1780809589.959561:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 66 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.959608:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 567 00000100:00100000:2.0:1780809589.959617:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2393:x1867312335000960:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809589.959628:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809589.959635:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 66 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.959647:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 66 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.959663:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f3c43 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468722f9 expref: 66 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.959681:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.959686:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.959693:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.959700:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.959728:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809589.959766:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312335000960:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 149us (274us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809589.959768:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.959778:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 567 00010000:00010000:1.0:1780809589.959781:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809589.959809:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809589.959814:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809589.959826:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959836:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959845:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959851:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959864:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959870:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809589.959875:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959883:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959892:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809589.959895:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809589.959899:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959905:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3c58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959941:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959948:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959954:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959959:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809589.959962:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959977:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959986:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:1.0:1780809589.959988:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809589.959991:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.959997:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3c5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.960026:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.960047:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 64 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809589.960054:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809589.960056:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809589.960059:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f200, rc 0) 00000100:00100000:1.0:1780809589.960090:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142680:x1867312335000576:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2946us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809589.960096:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7532 00000100:00100000:0.0:1780809589.961495:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.961532:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335001216 00000100:00100000:2.0:1780809589.961538:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335001216 00000100:00100000:2.0:1780809589.961568:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7533 00000100:00100000:2.0:1780809589.961575:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142680:x1867312335001216:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809589.961608:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809589.961620:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872307 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.961670:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.961680:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.961687:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.961704:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.961713:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 65 pid: 77629 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.961733:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338750976:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809589.961768:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cacc414c180 going to sleep for 11 seconds 00000100:00100000:2.0:1780809589.962411:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338750976:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809589.962425:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809589.962630:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809589.962653:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335001344 00000100:00100000:2.0:1780809589.962657:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335001344 00010000:00010000:2.0:1780809589.962671:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 66 pid: 77629 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.962691:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 568 00000100:00100000:2.0:1780809589.962696:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2394:x1867312335001344:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809589.962704:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809589.962709:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 66 pid: 77629 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.962720:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 66 pid: 77629 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.962733:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c66 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872300 expref: 66 pid: 77629 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.962747:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809589.962749:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.962759:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.962763:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809589.962776:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809589.962796:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809589.962797:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2394:x1867312335001344:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 101us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809589.962811:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 568 00010000:00010000:0.0:1780809589.962811:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809589.962823:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809589.962949:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 66 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.962964:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 65 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809589.962974:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809589.962976:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809589.962977:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:0.0:1780809589.963000:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:142680:x1867312335001216:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1426us (1505us total) trans 55834578671 rc 0/0 00000100:00100000:0.0:1780809589.963004:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7533 00000100:00100000:0.0:1780809590.005548:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809590.005622:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335001600 00000100:00100000:3.0:1780809590.005632:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335001600 00000100:00080000:0.0:1780809590.005675:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809590.005696:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1822 00000100:00100000:3.0:1780809590.005707:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5048850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:142659:x1867312335001600:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809590.005919:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5048850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:142659:x1867312335001600:12345-192.168.203.33@tcp:35:dd.0 Request processed in 212us (379us total) trans 55834578672 rc 0/0 00000100:00100000:3.0:1780809590.005937:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1822 00000100:00100000:1.0:1780809590.017690:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.017752:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335001856 00000100:00100000:2.0:1780809590.017761:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335001856 00000100:00100000:2.0:1780809590.017811:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7534 00000100:00100000:2.0:1780809590.017820:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:142687:x1867312335001856:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809590.017839:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809590.017855:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687230e expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.017923:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.017950:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.017960:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.017982:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018011:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018018:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018311:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3c97 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018318:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3c97 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018323:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3c97 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809590.018329:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809590.018407:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018413:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018417:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018421:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809590.018424:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018428:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018443:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809590.018445:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809590.018449:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018453:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018472:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018475:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018478:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018482:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809590.018483:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018487:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018490:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54100) 00010000:00010000:2.0:1780809590.018492:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809590.018493:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018496:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3c90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018532:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3c82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687230e expref: 69 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018550:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3c97 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687230e expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.018554:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.018556:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809590.018558:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:2.0:1780809590.018636:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142687:x1867312335001856:12345-192.168.203.33@tcp:101:dd.0 Request processed in 817us (953us total) trans 55834578673 rc 0/0 00000100:00100000:2.0:1780809590.018648:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7534 00000100:00100000:1.0:1780809590.019902:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.019951:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335001984 00000100:00100000:2.0:1780809590.019955:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335001984 00000100:00100000:2.0:1780809590.019984:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2163 00000100:00100000:2.0:1780809590.019989:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2393:x1867312335001984:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809590.019998:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.020009:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3c97 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687230e expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.020022:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.020025:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809590.020047:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:2393:x1867312335001984:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.020052:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2163 00000100:00100000:1.0:1780809590.131751:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338751104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780809590.131815:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809590.131870:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338751104 00000100:00100000:2.0:1780809590.131878:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338751104 00000100:00100000:2.0:1780809590.131943:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1780809590.131953:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338751104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780809590.131990:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:2.0:1780809590.132048:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338751104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.132056:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1780809590.132088:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338751104:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1780809590.132115:0:78218:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1780809590.139505:0:8788:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 645872a2-00b2-4cf6-9c95-e2d5667df9bf 00000020:00000080:2.0:1780809590.139514:0:8788:0:(genops.c:906:class_export_put()) final put ffff9cacc62ee800/645872a2-00b2-4cf6-9c95-e2d5667df9bf 00000020:00000080:0.0:1780809590.139542:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9cacc62ee800/645872a2-00b2-4cf6-9c95-e2d5667df9bf for lustre-OST0001 00000020:00000080:0.0:1780809590.139586:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cacc62ed000 for lustre-OST0001 00000100:00100000:0.0:1780809590.305135:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809590.305202:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335002240 00000100:00100000:3.0:1780809590.305211:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335002240 00000100:00100000:3.0:1780809590.305267:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1823 00000100:00100000:3.0:1780809590.305277:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142687:x1867312335002240:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809590.305485:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142687:x1867312335002240:12345-192.168.203.33@tcp:35:dd.0 Request processed in 208us (356us total) trans 55834578674 rc 0/0 00000100:00100000:3.0:1780809590.305492:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1823 00010000:00010000:0.0:1780809590.323742:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809590.332999:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809590.333052:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335002496 00000100:00100000:0.0:1780809590.333061:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335002496 00000100:00100000:0.0:1780809590.333111:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7535 00000100:00100000:0.0:1780809590.333122:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142695:x1867312335002496:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809590.333143:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809590.333163:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872315 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333226:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333252:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333261:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333274:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333281:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333286:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333665:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f3cba lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333674:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f3cba lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333682:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f3cba lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809590.333692:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809590.333775:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333784:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333789:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333802:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809590.333807:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333814:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333825:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809590.333828:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809590.333832:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333838:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333852:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333857:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333862:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333867:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809590.333870:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333874:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333890:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809590.333892:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809590.333894:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333900:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3cb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333950:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872315 expref: 71 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333964:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f3cba lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872315 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.333971:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809590.333974:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809590.333976:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf000, rc 0) 00000100:00100000:0.0:1780809590.334031:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:142695:x1867312335002496:12345-192.168.203.33@tcp:101:dd.0 Request processed in 912us (1039us total) trans 55834578675 rc 0/0 00000100:00100000:0.0:1780809590.334038:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7535 00000100:00100000:1.0:1780809590.335223:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.335277:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335002624 00000100:00100000:2.0:1780809590.335284:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335002624 00000100:00100000:2.0:1780809590.335320:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2164 00000100:00100000:2.0:1780809590.335327:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:2391:x1867312335002624:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809590.335335:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.335347:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f3cba lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872315 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.335358:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.335361:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809590.335384:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:2391:x1867312335002624:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 59us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.335388:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2164 00000100:00100000:2.0:1780809590.533797:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809590.533848:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335002880 00000100:00100000:3.0:1780809590.533856:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335002880 00000100:00100000:3.0:1780809590.533901:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7536 00000100:00100000:3.0:1780809590.533910:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:142701:x1867312335002880:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809590.533939:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809590.533958:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687231c expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534022:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534036:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534046:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534057:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534064:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534084:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534417:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3cdd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534424:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3cdd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534429:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3cdd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809590.534435:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809590.534507:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534515:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534522:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534525:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809590.534528:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534533:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534541:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809590.534543:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809590.534551:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534555:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ccf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534565:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534569:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534572:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534575:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809590.534576:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534580:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534583:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91500) 00010000:00010000:3.0:1780809590.534585:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809590.534586:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534640:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534687:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687231c expref: 72 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534712:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3cdd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687231c expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.534717:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809590.534719:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809590.534720:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809590.534764:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142701:x1867312335002880:12345-192.168.203.33@tcp:101:dd.0 Request processed in 855us (972us total) trans 55834578676 rc 0/0 00000100:00100000:3.0:1780809590.534771:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7536 00000100:00100000:1.0:1780809590.535796:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.535840:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335003008 00000100:00100000:2.0:1780809590.535844:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335003008 00000100:00100000:1.0:1780809590.535845:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.535881:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2165 00000100:00100000:3.0:1780809590.535892:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335003264 00000100:00100000:2.0:1780809590.535898:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2394:x1867312335003008:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809590.535899:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335003264 00010000:00010000:2.0:1780809590.535910:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.535937:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3cdd lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687231c expref: 72 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.535951:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00000100:00100000:3.0:1780809590.535956:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1824 00010000:00010000:2.0:1780809590.535956:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809590.535966:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142701:x1867312335003264:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809590.535992:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2394:x1867312335003008:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 96us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.536001:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2165 00000100:00100000:3.0:1780809590.536091:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142701:x1867312335003264:12345-192.168.203.33@tcp:35:dd.0 Request processed in 127us (243us total) trans 55834578677 rc 0/0 00000100:00100000:3.0:1780809590.536098:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1824 00000100:00100000:1.0:1780809590.591520:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809590.591581:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335003392 00000100:00100000:3.0:1780809590.591607:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335003392 00000100:00100000:3.0:1780809590.591650:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7537 00000100:00100000:3.0:1780809590.591658:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142708:x1867312335003392:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809590.591677:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809590.591692:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872323 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.591748:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.591775:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.591786:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.591802:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.591809:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.591815:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.592172:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.592186:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 72 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.592195:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.592228:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 72 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.592241:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 72 pid: 80225 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809590.592269:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338751232:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809590.592330:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd9c6d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809590.593137:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338751232:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809590.593161:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809590.593288:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809590.593324:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335003648 00000100:00100000:3.0:1780809590.593328:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335003648 00000100:00100000:3.0:1780809590.593357:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1825 00000100:00100000:3.0:1780809590.593368:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:89646:x1867312335003648:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809590.593517:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:89646:x1867312335003648:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 150us (229us total) trans 55834578678 rc 0/0 00000100:00100000:3.0:1780809590.593522:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1825 00000100:00100000:1.0:1780809590.594149:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.594190:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335003776 00000100:00100000:2.0:1780809590.594195:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335003776 00010000:00010000:2.0:1780809590.594216:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 74 pid: 80225 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.594241:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 569 00000100:00100000:2.0:1780809590.594249:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2393:x1867312335003776:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809590.594259:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.594265:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 74 pid: 80225 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.594277:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 74 pid: 80225 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.594292:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3c74 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872307 expref: 74 pid: 80225 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.594327:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.594332:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.594339:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.594345:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.594362:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809590.594390:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.594391:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2393:x1867312335003776:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 140us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.594407:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 569 00010000:00010000:3.0:1780809590.594409:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809590.594437:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809590.594441:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809590.594454:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594466:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594484:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594490:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594496:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594501:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809590.594505:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594512:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594520:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809590.594523:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809590.594527:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594532:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3cf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594543:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594549:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594555:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594565:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809590.594567:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594572:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594579:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91500) 00010000:00010000:3.0:1780809590.594581:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809590.594584:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594631:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3cf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594660:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 73 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594674:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 72 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.594682:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809590.594684:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809590.594686:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031200, rc 0) 00000100:00100000:3.0:1780809590.594710:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142708:x1867312335003392:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3053us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809590.594715:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7537 00000100:00100000:1.0:1780809590.596200:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.596238:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335004032 00000100:00100000:2.0:1780809590.596243:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335004032 00000100:00100000:2.0:1780809590.596272:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7538 00000100:00100000:2.0:1780809590.596281:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142708:x1867312335004032:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809590.596297:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809590.596308:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3d07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687232a expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.596358:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.596367:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 73 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.596386:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.596409:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 73 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.596420:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 73 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.596430:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338751360:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809590.596469:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc8628300 going to sleep for 11 seconds 00000100:00100000:2.0:1780809590.597146:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338751360:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809590.597162:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809590.597426:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.597464:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335004160 00000100:00100000:2.0:1780809590.597469:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335004160 00010000:00010000:2.0:1780809590.597491:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 74 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.597515:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 570 00000100:00100000:2.0:1780809590.597524:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2394:x1867312335004160:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809590.597532:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.597538:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 74 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.597561:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 74 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.597576:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3d00 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872323 expref: 74 pid: 77628 timeout: 1952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.597607:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.597612:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.597619:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.597626:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.597644:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809590.597672:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2394:x1867312335004160:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 149us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.597681:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 570 00010000:00010000:1.0:1780809590.597683:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809590.597690:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809590.597700:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809590.597787:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3d07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 74 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809590.597805:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 73 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809590.597810:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809590.597812:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809590.597814:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:1.0:1780809590.597844:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142708:x1867312335004032:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1564us (1645us total) trans 55834578679 rc 0/0 00000100:00100000:1.0:1780809590.597852:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7538 00000100:00100000:3.0:1780809590.643777:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338751488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780809590.643856:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809590.643905:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338751488 00000100:00100000:2.0:1780809590.643914:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338751488 00000100:00100000:2.0:1780809590.643981:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1780809590.643990:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338751488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780809590.644009:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809590.644049:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338751488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.644064:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1780809590.644095:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338751488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809590.652686:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809590.652756:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335004416 00000100:00100000:3.0:1780809590.652767:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335004416 00000100:00100000:3.0:1780809590.652813:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1826 00000100:00100000:3.0:1780809590.652820:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142695:x1867312335004416:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809590.653042:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:142695:x1867312335004416:12345-192.168.203.33@tcp:35:dd.0 Request processed in 221us (367us total) trans 55834578680 rc 0/0 00000100:00100000:3.0:1780809590.653050:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1826 00000100:00100000:0.0:1780809590.885373:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.885420:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335004672 00000100:00100000:2.0:1780809590.885429:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335004672 00000100:00100000:2.0:1780809590.885477:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7539 00000100:00100000:2.0:1780809590.885487:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:142716:x1867312335004672:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809590.885510:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809590.885532:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872331 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885624:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885637:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885647:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885657:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885661:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885665:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885955:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f3d31 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885974:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f3d31 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.885979:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f3d31 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809590.885986:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809590.886057:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886069:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886076:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886080:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809590.886082:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886087:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886095:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809590.886097:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809590.886100:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886103:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886131:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886134:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886138:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886141:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809590.886142:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886145:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886149:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:2.0:1780809590.886150:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809590.886152:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886155:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886193:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872331 expref: 77 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886202:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f3d31 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872331 expref: 76 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.886214:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.886215:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809590.886217:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:2.0:1780809590.886260:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142716:x1867312335004672:12345-192.168.203.33@tcp:101:dd.0 Request processed in 776us (894us total) trans 55834578681 rc 0/0 00000100:00100000:2.0:1780809590.886265:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7539 00000100:00100000:0.0:1780809590.887459:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.887492:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335004800 00000100:00100000:2.0:1780809590.887497:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335004800 00000100:00100000:2.0:1780809590.887524:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2166 00000100:00100000:2.0:1780809590.887529:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:2393:x1867312335004800:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809590.887538:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.887549:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f3d31 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872331 expref: 76 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.887559:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.887562:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809590.887606:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:2393:x1867312335004800:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.887612:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2166 00000100:00100000:1.0:1780809590.927177:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.927229:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335004928 00000100:00100000:2.0:1780809590.927238:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335004928 00000100:00100000:2.0:1780809590.927280:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7540 00000100:00100000:2.0:1780809590.927287:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:142722:x1867312335004928:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809590.927309:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809590.927336:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f3d3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872338 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927392:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927407:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927419:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927431:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927436:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927440:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927745:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927754:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 76 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927759:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927782:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 76 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.927799:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 76 pid: 77629 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.927809:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338751616:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809590.927876:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc8628300 going to sleep for 11 seconds 00000100:00100000:2.0:1780809590.928625:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338751616:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809590.928638:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809590.928773:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809590.928814:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335005184 00000100:00100000:3.0:1780809590.928818:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335005184 00000100:00100000:3.0:1780809590.928841:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1827 00000100:00100000:3.0:1780809590.928846:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:89646:x1867312335005184:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809590.929006:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:89646:x1867312335005184:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 159us (232us total) trans 55834578682 rc 0/0 00000100:00100000:3.0:1780809590.929012:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1827 00000100:00100000:0.0:1780809590.929658:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.929705:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335005312 00000100:00100000:2.0:1780809590.929708:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335005312 00010000:00010000:2.0:1780809590.929725:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 78 pid: 77629 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.929755:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 571 00000100:00100000:2.0:1780809590.929762:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2394:x1867312335005312:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809590.929771:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.929778:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 78 pid: 77629 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.929790:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 78 pid: 77629 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.929806:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f3d0e lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687232a expref: 78 pid: 77629 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.929842:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.929846:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.929853:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.929860:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.929882:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809590.929909:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2394:x1867312335005312:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 147us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.929918:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 571 00010000:00010000:3.0:1780809590.929929:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.929939:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809590.929975:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809590.929979:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809590.929992:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930011:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930017:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930022:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930026:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930030:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809590.930032:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930037:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930043:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809590.930045:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809590.930048:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930053:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f3d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930069:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930073:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930080:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930083:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809590.930085:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930088:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930092:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:3.0:1780809590.930093:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809590.930095:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930098:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f3d4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930118:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f3d3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930128:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 76 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809590.930132:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809590.930134:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809590.930135:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ec00, rc 0) 00000100:00100000:3.0:1780809590.930158:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142722:x1867312335004928:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2872us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809590.930170:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7540 00000100:00100000:0.0:1780809590.931537:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.931570:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335005568 00000100:00100000:2.0:1780809590.931574:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335005568 00000100:00100000:2.0:1780809590.931611:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7541 00000100:00100000:2.0:1780809590.931618:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142722:x1867312335005568:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809590.931627:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809590.931635:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3d5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687233f expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.931694:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.931706:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.931720:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.931736:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.931743:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 77 pid: 77627 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.931751:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338751744:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809590.931785:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc86283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780809590.932426:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338751744:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809590.932437:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809590.932570:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809590.932615:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335005696 00000100:00100000:2.0:1780809590.932619:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335005696 00010000:00010000:2.0:1780809590.932632:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 78 pid: 77627 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809590.932650:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 572 00000100:00100000:2.0:1780809590.932655:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2393:x1867312335005696:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809590.932661:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809590.932665:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 78 pid: 77627 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.932681:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 78 pid: 77627 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.932691:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f3d54 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872338 expref: 78 pid: 77627 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.932703:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809590.932705:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.932710:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.932714:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809590.932726:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809590.932746:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2393:x1867312335005696:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 91us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809590.932752:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 572 00010000:00010000:0.0:1780809590.932759:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.932777:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809590.932788:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809590.932902:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f3d5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 78 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.932932:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 77 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809590.932939:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809590.932942:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809590.932944:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:0.0:1780809590.932973:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142722:x1867312335005568:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1355us (1436us total) trans 55834578683 rc 0/0 00000100:00100000:0.0:1780809590.932980:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7541 00000100:00100000:0.0:1780809591.082312:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.082396:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335005952 00000100:00100000:3.0:1780809591.082406:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335005952 00000100:00100000:3.0:1780809591.082452:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7542 00000100:00100000:3.0:1780809591.082460:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142736:x1867312335005952:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809591.082483:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809591.082500:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3d70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872346 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082566:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082579:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082614:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082624:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082628:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082632:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082940:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3d85 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082961:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3d85 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.082969:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3d85 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809591.082978:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809591.083053:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083058:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083062:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083066:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809591.083069:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083075:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083083:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809591.083085:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809591.083089:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083093:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083109:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083113:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083116:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083119:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809591.083120:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083123:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083127:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91500) 00010000:00010000:3.0:1780809591.083129:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809591.083130:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083133:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083163:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3d70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872346 expref: 80 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083171:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3d85 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872346 expref: 79 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.083182:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809591.083184:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809591.083185:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809591.083240:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142736:x1867312335005952:12345-192.168.203.33@tcp:101:dd.0 Request processed in 779us (933us total) trans 55834578684 rc 0/0 00000100:00100000:3.0:1780809591.083248:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7542 00000100:00100000:1.0:1780809591.084360:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809591.084403:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335006080 00000100:00100000:2.0:1780809591.084410:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335006080 00000100:00100000:1.0:1780809591.084414:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809591.084453:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2167 00000100:00100000:2.0:1780809591.084463:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2392:x1867312335006080:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809591.084476:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809591.084490:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3d85 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872346 expref: 79 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.084510:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809591.084513:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809591.084533:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335006336 00000100:00100000:3.0:1780809591.084538:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335006336 00000100:00100000:2.0:1780809591.084544:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2392:x1867312335006080:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809591.084550:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2167 00000100:00100000:3.0:1780809591.084574:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1828 00000100:00100000:3.0:1780809591.084584:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc895f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:142736:x1867312335006336:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809591.084724:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc895f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142736:x1867312335006336:12345-192.168.203.33@tcp:35:dd.0 Request processed in 144us (313us total) trans 55834578685 rc 0/0 00000100:00100000:3.0:1780809591.084729:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1828 00000100:00100000:1.0:1780809591.212030:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.212093:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335006592 00000100:00100000:3.0:1780809591.212104:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335006592 00000100:00100000:3.0:1780809591.212168:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1829 00000100:00100000:3.0:1780809591.212180:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142716:x1867312335006592:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809591.212399:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:142716:x1867312335006592:12345-192.168.203.33@tcp:35:dd.0 Request processed in 221us (377us total) trans 55834578686 rc 0/0 00000100:00100000:3.0:1780809591.212407:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1829 00000100:00100000:1.0:1780809591.293766:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809591.293792:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809591.293812:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.293831:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335006720 00000100:00100000:1.0:1780809591.293836:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.293843:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335006720 00000100:00100000:0.0:1780809591.293857:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335006848 00000100:00100000:0.0:1780809591.293863:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335006848 00000100:00100000:2.0:1780809591.293867:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335006976 00000100:00100000:1.0:1780809591.293867:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809591.293874:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335006976 00000100:00100000:3.0:1780809591.293911:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 387 00000100:00100000:0.0:1780809591.293912:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335007104 00000100:00100000:0.0:1780809591.293928:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335007104 00000100:00100000:2.0:1780809591.293934:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 659 00000100:00100000:3.0:1780809591.293938:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf4fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312335006720:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809591.293944:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335007232 00000100:00100000:2.0:1780809591.293946:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335006976:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809591.293949:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335007232 00000100:00100000:0.0:1780809591.293962:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1093 00000100:00100000:0.0:1780809591.293972:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312335006848:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809591.293994:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1094 00000100:00100000:1.0:1780809591.294005:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335007104:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809591.294022:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335006976:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809591.294023:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf4fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312335006720:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809591.294023:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312335006848:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809591.294043:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 659 00000100:00100000:1.0:1780809591.294044:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335007104:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 38us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809591.294047:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 387 00000100:00100000:0.0:1780809591.294047:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1093 00000100:00100000:1.0:1780809591.294062:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1094 00000100:00100000:0.0:1780809591.294083:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1095 00000100:00100000:0.0:1780809591.294097:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335007232:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:1.0:1780809591.294118:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780809591.294123:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780809591.294126:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780809591.294130:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335007232:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809591.294140:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1095 00000100:00100000:0.0:1780809591.334174:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.334232:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335007488 00000100:00100000:3.0:1780809591.334239:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335007488 00000100:00100000:3.0:1780809591.334281:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7543 00000100:00100000:3.0:1780809591.334287:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:142744:x1867312335007488:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809591.334305:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809591.334321:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687234d expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334373:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334385:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334392:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334401:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334405:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334408:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334719:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3da8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334734:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3da8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334742:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3da8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809591.334752:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809591.334831:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334836:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334840:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334844:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809591.334847:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334852:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334860:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809591.334862:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809591.334865:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334869:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3d9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334885:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334888:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334892:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334894:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809591.334896:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334899:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334903:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91500) 00010000:00010000:3.0:1780809591.334904:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809591.334906:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334910:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3da1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334969:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687234d expref: 83 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334981:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3da8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687234d expref: 82 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.334993:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809591.334995:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809591.334997:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809591.335039:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142744:x1867312335007488:12345-192.168.203.33@tcp:101:dd.0 Request processed in 752us (871us total) trans 55834578687 rc 0/0 00000100:00100000:3.0:1780809591.335044:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7543 00000100:00100000:2.0:1780809591.336081:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809591.336121:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335007616 00000100:00100000:0.0:1780809591.336125:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335007616 00000100:00100000:0.0:1780809591.336151:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2168 00000100:00100000:0.0:1780809591.336155:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2394:x1867312335007616:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809591.336162:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809591.336172:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3da8 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687234d expref: 82 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.336180:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809591.336183:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809591.336207:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:2394:x1867312335007616:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809591.336211:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2168 00010000:00010000:1.0:1780809591.347749:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809591.363119:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809591.363177:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335007744 00000100:00100000:2.0:1780809591.363185:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335007744 00000100:00100000:2.0:1780809591.363232:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7544 00000100:00100000:2.0:1780809591.363242:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:142750:x1867312335007744:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809591.363265:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809591.363283:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872354 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363333:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363344:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363360:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363372:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363379:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363385:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363644:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363652:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 82 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363658:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363691:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 82 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809591.363701:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 82 pid: 78216 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809591.363711:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc5e51880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338751872:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809591.363771:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc8628300 going to sleep for 11 seconds 00000100:00100000:0.0:1780809591.364629:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc5e51880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338751872:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809591.364648:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809591.364674:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.364722:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335008000 00000100:00100000:3.0:1780809591.364726:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335008000 00000100:00100000:3.0:1780809591.364754:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1830 00000100:00100000:3.0:1780809591.364759:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:89645:x1867312335008000:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809591.364891:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:89645:x1867312335008000:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 130us (230us total) trans 55834578688 rc 0/0 00000100:00100000:3.0:1780809591.364898:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1830 00000100:00100000:2.0:1780809591.365583:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809591.365620:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335008128 00000100:00100000:1.0:1780809591.365625:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335008128 00010000:00010000:1.0:1780809591.365641:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 84 pid: 78216 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809591.365661:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 573 00000100:00100000:1.0:1780809591.365671:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312335008128:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809591.365679:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809591.365684:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 84 pid: 78216 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.365699:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 84 pid: 78216 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.365710:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f3d62 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687233f expref: 84 pid: 78216 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.365723:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809591.365726:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.365732:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.365735:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.365748:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809591.365769:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2393:x1867312335008128:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 97us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809591.365771:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809591.365778:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 573 00010000:00010000:0.0:1780809591.365781:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809591.365809:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809591.365813:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809591.365822:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365830:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365837:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365841:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365846:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365850:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809591.365852:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365857:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365862:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809591.365864:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809591.365867:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365870:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f3dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365941:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365945:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365948:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365951:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809591.365953:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365956:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365961:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54100) 00010000:00010000:0.0:1780809591.365963:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809591.365965:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365968:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f3dc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.365996:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f3db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 83 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.366006:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 82 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809591.366029:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809591.366031:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809591.366033:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:0.0:1780809591.366065:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142750:x1867312335007744:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2824us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809591.366072:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7544 00000100:00100000:2.0:1780809591.367304:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.367346:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335008384 00000100:00100000:3.0:1780809591.367351:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335008384 00000100:00100000:3.0:1780809591.367392:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7545 00000100:00100000:3.0:1780809591.367401:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:142750:x1867312335008384:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809591.367413:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809591.367422:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687235b expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.367472:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.367483:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 83 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.367498:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.367516:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 83 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.367523:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 83 pid: 80225 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809591.367531:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338752000:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809591.367567:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd0c239c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809591.368116:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338752000:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809591.368130:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809591.368315:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809591.368347:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335008512 00000100:00100000:1.0:1780809591.368352:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335008512 00010000:00010000:1.0:1780809591.368375:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 84 pid: 80225 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809591.368405:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 574 00000100:00100000:1.0:1780809591.368411:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2394:x1867312335008512:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809591.368417:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809591.368421:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 84 pid: 80225 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.368428:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 84 pid: 80225 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.368436:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f3dcb lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872354 expref: 84 pid: 80225 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.368447:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809591.368449:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.368454:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.368458:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.368469:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809591.368490:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2394:x1867312335008512:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 80us (175us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809591.368493:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809591.368497:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 574 00010000:00010000:3.0:1780809591.368503:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809591.368511:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809591.368583:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 84 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.368621:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 83 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.368640:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809591.368642:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809591.368645:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809591.368672:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:142750:x1867312335008384:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1273us (1368us total) trans 55834578689 rc 0/0 00000100:00100000:3.0:1780809591.368679:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7545 00000100:00100000:2.0:1780809591.432786:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809591.432836:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335008768 00000100:00100000:1.0:1780809591.432854:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335008768 00000100:00100000:1.0:1780809591.432898:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7546 00000100:00100000:1.0:1780809591.432904:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:142757:x1867312335008768:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809591.432935:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809591.432950:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872362 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433004:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433021:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433029:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433038:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433042:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433046:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433326:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3dfc lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433332:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3dfc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433336:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3dfc lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809591.433348:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809591.433430:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433438:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433443:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433449:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809591.433453:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433460:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433471:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809591.433473:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809591.433476:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433480:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3dee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433488:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433491:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433509:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433512:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809591.433514:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433518:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433522:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:1.0:1780809591.433523:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809591.433525:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433528:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3df5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433557:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f3de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872362 expref: 86 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433565:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3dfc lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872362 expref: 85 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.433570:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809591.433571:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809591.433573:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:1.0:1780809591.433650:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:142757:x1867312335008768:12345-192.168.203.33@tcp:101:dd.0 Request processed in 745us (870us total) trans 55834578690 rc 0/0 00000100:00100000:1.0:1780809591.433662:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7546 00000100:00100000:1.0:1780809591.434676:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809591.434704:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809591.434708:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335008896 00000100:00100000:0.0:1780809591.434743:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335008896 00000100:00100000:3.0:1780809591.434757:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335009152 00000100:00100000:3.0:1780809591.434764:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335009152 00000100:00100000:0.0:1780809591.434777:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2169 00000100:00100000:0.0:1780809591.434786:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee578380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:2393:x1867312335008896:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809591.434794:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809591.434802:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1831 00010000:00010000:0.0:1780809591.434807:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f3dfc lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872362 expref: 86 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809591.434814:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:142757:x1867312335009152:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:0.0:1780809591.434820:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809591.434825:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809591.434851:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee578380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:2393:x1867312335008896:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809591.434860:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2169 00000100:00100000:3.0:1780809591.434960:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:142757:x1867312335009152:12345-192.168.203.33@tcp:35:dd.0 Request processed in 149us (259us total) trans 55834578691 rc 0/0 00000100:00100000:3.0:1780809591.434968:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1831 00000100:00100000:1.0:1780809591.648322:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.648384:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335009408 00000100:00100000:3.0:1780809591.648393:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335009408 00000100:00100000:3.0:1780809591.648442:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1832 00000100:00100000:3.0:1780809591.648451:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc7106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:142744:x1867312335009408:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809591.648701:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc7106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:142744:x1867312335009408:12345-192.168.203.33@tcp:35:dd.0 Request processed in 251us (385us total) trans 55834578692 rc 0/0 00000100:00100000:3.0:1780809591.648707:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1832 00000001:00080000:1.0:1780809591.673750:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578683 is committed 00000001:00080000:1.0:1780809591.673785:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578690 is committed 00000001:00080000:1.0:1780809591.673821:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578692 is committed 00000100:00100000:2.0:1780809591.880218:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809591.880273:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335009664 00000100:00100000:3.0:1780809591.880281:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335009664 00000100:00100000:3.0:1780809591.880331:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7547 00000100:00100000:3.0:1780809591.880348:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+17:142765:x1867312335009664:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809591.880388:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809591.880407:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872369 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880470:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880481:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880489:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880498:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880502:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880506:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880806:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3e1f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880813:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3e1f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880817:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3e1f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809591.880825:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809591.880941:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880947:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880951:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880954:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809591.880957:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880962:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880970:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809591.880972:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809591.880975:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880978:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880985:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880989:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.880992:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.881002:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809591.881004:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.881008:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.881011:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809591.881013:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809591.881014:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.881017:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.881045:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872369 expref: 20 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.881053:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3e1f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872369 expref: 19 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809591.881058:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809591.881059:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809591.881061:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030400, rc 0) 00000100:00100000:3.0:1780809591.881103:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:142765:x1867312335009664:12345-192.168.203.33@tcp:101:dd.0 Request processed in 759us (892us total) trans 55834578693 rc 0/0 00000100:00100000:3.0:1780809591.881107:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7547 00000100:00100000:2.0:1780809591.882234:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809591.882281:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335009792 00000100:00100000:1.0:1780809591.882287:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335009792 00000100:00100000:1.0:1780809591.882328:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2170 00000100:00100000:1.0:1780809591.882337:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2394:x1867312335009792:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809591.882348:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809591.882363:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f3e1f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872369 expref: 19 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809591.882377:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809591.882381:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809591.882412:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2394:x1867312335009792:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809591.882420:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2170 00000100:00100000:1.0:1780809592.075814:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809592.075867:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335010048 00000100:00100000:0.0:1780809592.075877:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335010048 00000100:00080000:1.0:1780809592.075930:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809592.075952:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7548 00000100:00100000:0.0:1780809592.075964:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:142778:x1867312335010048:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809592.075984:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809592.076002:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872370 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076078:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076097:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076107:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076120:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076127:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076133:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076471:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f3e42 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076481:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f3e42 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076489:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f3e42 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809592.076498:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809592.076578:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076624:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076632:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076638:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809592.076643:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076651:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076663:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809592.076666:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809592.076671:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076677:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076695:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076701:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076707:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076711:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809592.076720:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076727:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076735:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83b00) 00010000:00010000:0.0:1780809592.076738:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809592.076740:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076746:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076785:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872370 expref: 21 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076799:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f3e42 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872370 expref: 20 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.076807:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809592.076809:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809592.076812:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf200, rc 0) 00000100:00100000:0.0:1780809592.076865:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142778:x1867312335010048:12345-192.168.203.33@tcp:101:dd.0 Request processed in 904us (1058us total) trans 55834578694 rc 0/0 00000100:00100000:0.0:1780809592.076872:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7548 00000100:00100000:2.0:1780809592.077941:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809592.077994:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335010176 00000100:00100000:1.0:1780809592.078000:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335010176 00000100:00100000:1.0:1780809592.078039:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2171 00000100:00100000:1.0:1780809592.078047:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2393:x1867312335010176:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809592.078067:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809592.078081:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f3e42 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872370 expref: 20 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809592.078094:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:1.0:1780809592.078101:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809592.078106:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809592.078134:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2393:x1867312335010176:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809592.078140:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335010432 00000100:00100000:1.0:1780809592.078142:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2171 00000100:00100000:3.0:1780809592.078150:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335010432 00000100:00100000:3.0:1780809592.078176:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1833 00000100:00100000:3.0:1780809592.078184:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:142778:x1867312335010432:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809592.078307:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142778:x1867312335010432:12345-192.168.203.33@tcp:35:dd.0 Request processed in 123us (218us total) trans 55834578695 rc 0/0 00000100:00100000:3.0:1780809592.078315:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1833 00000100:00100000:2.0:1780809592.177206:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.177251:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335010688 00000100:00100000:3.0:1780809592.177259:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335010688 00000100:00100000:3.0:1780809592.177305:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1834 00000100:00100000:3.0:1780809592.177316:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:142765:x1867312335010688:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809592.177505:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:142765:x1867312335010688:12345-192.168.203.33@tcp:35:dd.0 Request processed in 191us (304us total) trans 55834578696 rc 0/0 00000100:00100000:3.0:1780809592.177510:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1834 00000100:00100000:2.0:1780809592.195726:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.195788:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335010816 00000100:00100000:3.0:1780809592.195799:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335010816 00000100:00100000:3.0:1780809592.195858:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7549 00000100:00100000:3.0:1780809592.195870:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:142786:x1867312335010816:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809592.195892:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809592.195925:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872377 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.195984:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196000:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196010:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196038:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196046:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196053:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196360:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196371:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 22 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196379:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196407:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 22 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.196419:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 22 pid: 78216 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809592.196432:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338752128:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809592.196498:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397000 going to sleep for 11 seconds 00000100:00100000:3.0:1780809592.197263:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338752128:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809592.197286:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809592.197360:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.197394:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335011072 00000100:00100000:3.0:1780809592.197399:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335011072 00000100:00100000:3.0:1780809592.197434:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1835 00000100:00100000:3.0:1780809592.197442:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:89645:x1867312335011072:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809592.197631:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:89645:x1867312335011072:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 148us (228us total) trans 55834578697 rc 0/0 00000100:00100000:3.0:1780809592.197641:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1835 00000100:00100000:2.0:1780809592.198195:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809592.198233:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335011200 00000100:00100000:0.0:1780809592.198237:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335011200 00010000:00010000:0.0:1780809592.198260:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 24 pid: 78216 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809592.198289:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 575 00000100:00100000:0.0:1780809592.198294:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5525450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2394:x1867312335011200:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809592.198301:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809592.198306:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 24 pid: 78216 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.198314:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 24 pid: 78216 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.198326:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3dd9 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687235b expref: 24 pid: 78216 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.198336:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809592.198339:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.198344:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.198348:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.198365:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809592.198391:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809592.198393:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5525450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2394:x1867312335011200:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809592.198406:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 575 00010000:00010000:3.0:1780809592.198408:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809592.198435:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809592.198439:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809592.198452:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198464:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198473:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198479:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198486:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198501:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809592.198504:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198509:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198517:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809592.198519:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809592.198522:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198526:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198532:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198536:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198539:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198542:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809592.198543:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198547:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198556:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809592.198558:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809592.198559:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198562:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198581:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198614:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 22 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.198618:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809592.198620:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809592.198622:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809592.198649:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142786:x1867312335010816:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2781us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809592.198654:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7549 00000100:00100000:2.0:1780809592.199777:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809592.199798:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335011456 00000100:00100000:0.0:1780809592.199808:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335011456 00000100:00100000:0.0:1780809592.199831:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7550 00000100:00100000:0.0:1780809592.199836:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:142786:x1867312335011456:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809592.199844:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809592.199852:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687237e expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.199900:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.199922:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.199931:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.199952:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.199964:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 23 pid: 77627 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809592.199975:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338752256:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809592.200009:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc12ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809592.200569:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338752256:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809592.200583:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809592.200776:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809592.200808:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335011584 00000100:00100000:1.0:1780809592.200812:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335011584 00010000:00010000:1.0:1780809592.200827:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 24 pid: 77627 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809592.200845:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 576 00000100:00100000:1.0:1780809592.200852:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2393:x1867312335011584:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809592.200861:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809592.200866:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 24 pid: 77627 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.200877:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 24 pid: 77627 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.200891:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3e65 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872377 expref: 24 pid: 77627 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.200902:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809592.200909:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.200925:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.200929:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.200941:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809592.200961:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809592.200962:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2393:x1867312335011584:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 112us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809592.200975:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 576 00010000:00010000:0.0:1780809592.200979:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809592.200992:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809592.201112:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 24 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.201132:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 23 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.201140:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809592.201142:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809592.201145:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf400, rc 0) 00000100:00100000:0.0:1780809592.201175:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:142786:x1867312335011456:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1338us (1398us total) trans 55834578698 rc 0/0 00000100:00100000:0.0:1780809592.201183:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7550 00000100:00100000:2.0:1780809592.226383:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.226442:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335011840 00000100:00100000:3.0:1780809592.226452:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335011840 00000100:00100000:3.0:1780809592.226502:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7551 00000100:00100000:3.0:1780809592.226511:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:142793:x1867312335011840:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809592.226533:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809592.226551:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3e81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872385 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.226663:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.226677:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.226688:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.226700:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.226706:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.226712:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227037:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3e96 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227046:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3e96 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227054:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3e96 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809592.227063:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809592.227142:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227158:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227164:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227169:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809592.227173:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227181:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227192:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809592.227194:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809592.227199:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227205:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3e88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227217:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227223:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227228:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227233:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809592.227240:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227246:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227252:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809592.227254:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809592.227256:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227262:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3e8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227295:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3e81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872385 expref: 26 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227306:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3e96 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872385 expref: 25 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.227313:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809592.227315:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809592.227318:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809592.227368:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142793:x1867312335011840:12345-192.168.203.33@tcp:101:dd.0 Request processed in 858us (990us total) trans 55834578699 rc 0/0 00000100:00100000:3.0:1780809592.227374:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7551 00000100:00100000:2.0:1780809592.228487:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809592.228538:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335011968 00000100:00100000:1.0:1780809592.228544:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335011968 00000100:00100000:1.0:1780809592.228580:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2172 00000100:00100000:1.0:1780809592.228606:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:2394:x1867312335011968:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809592.228619:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809592.228636:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3e96 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872385 expref: 25 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.228650:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809592.228654:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809592.228684:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2394:x1867312335011968:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 98us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809592.228689:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2172 00000100:00100000:2.0:1780809592.336630:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809592.336685:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335012096 00000100:00100000:1.0:1780809592.336694:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335012096 00000100:00100000:1.0:1780809592.336734:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7552 00000100:00100000:1.0:1780809592.336755:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:142799:x1867312335012096:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809592.336779:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809592.336796:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687238c expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.336857:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.336877:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.336889:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.336902:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.336919:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.336925:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.337189:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.337201:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 25 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.337210:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.337244:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 25 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.337254:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 25 pid: 80225 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809592.337263:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338752384:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809592.337325:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd03b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780809592.338162:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338752384:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809592.338182:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809592.338377:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.338431:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335012352 00000100:00100000:3.0:1780809592.338437:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335012352 00000100:00100000:3.0:1780809592.338477:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1836 00000100:00100000:3.0:1780809592.338486:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:89645:x1867312335012352:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809592.338690:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:89645:x1867312335012352:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 205us (312us total) trans 55834578700 rc 0/0 00000100:00100000:3.0:1780809592.338698:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1836 00000100:00100000:2.0:1780809592.339457:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809592.339499:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335012480 00000100:00100000:0.0:1780809592.339505:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335012480 00010000:00010000:0.0:1780809592.339527:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 27 pid: 80225 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809592.339552:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 577 00000100:00100000:0.0:1780809592.339558:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2393:x1867312335012480:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809592.339567:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809592.339581:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 27 pid: 80225 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.339620:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 27 pid: 80225 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.339638:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3e73 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687237e expref: 27 pid: 80225 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.339655:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809592.339659:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.339667:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.339673:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.339694:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809592.339721:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2393:x1867312335012480:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 162us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809592.339730:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 577 00010000:00010000:1.0:1780809592.339733:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339743:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809592.339772:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809592.339777:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809592.339792:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339802:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339811:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339828:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339836:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339841:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809592.339845:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339852:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339863:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809592.339866:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809592.339869:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339876:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f3eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339887:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339902:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339922:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339927:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809592.339937:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339944:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339957:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809592.339959:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809592.339966:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.339972:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f3eb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.340005:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.340019:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 25 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.340027:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809592.340029:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809592.340032:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64200, rc 0) 00000100:00100000:1.0:1780809592.340064:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142799:x1867312335012096:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3312us (3443us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809592.340071:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7552 00000100:00100000:2.0:1780809592.341574:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.341627:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335012736 00000100:00100000:3.0:1780809592.341632:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335012736 00000100:00100000:3.0:1780809592.341666:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7553 00000100:00100000:3.0:1780809592.341675:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:142799:x1867312335012736:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809592.341690:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809592.341703:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872393 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.341765:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.341777:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.341785:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.341810:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.341822:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 26 pid: 77629 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809592.341833:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338752512:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809592.341905:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780809592.342681:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338752512:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809592.342705:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809592.342772:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809592.342804:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335012864 00000100:00100000:1.0:1780809592.342809:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335012864 00010000:00010000:1.0:1780809592.342828:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 27 pid: 77629 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809592.342877:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 578 00000100:00100000:1.0:1780809592.342889:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2394:x1867312335012864:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809592.342899:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809592.342905:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 27 pid: 77629 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.342927:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 27 pid: 77629 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.342943:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3eb9 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687238c expref: 27 pid: 77629 timeout: 1954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.342955:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809592.342960:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.342966:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.342972:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.342993:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809592.343020:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809592.343026:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2394:x1867312335012864:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809592.343032:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809592.343040:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 578 00000004:00200000:3.0:1780809592.343047:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809592.343149:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 27 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.343164:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 26 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.343171:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809592.343173:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809592.343176:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809592.343209:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:142799:x1867312335012736:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1535us (1635us total) trans 55834578701 rc 0/0 00000100:00100000:3.0:1780809592.343215:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7553 00010000:00010000:1.0:1780809592.371722:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780809592.514066:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.514122:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335013120 00000100:00100000:3.0:1780809592.514131:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335013120 00000100:00100000:3.0:1780809592.514177:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1837 00000100:00100000:3.0:1780809592.514184:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:142793:x1867312335013120:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809592.514404:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:142793:x1867312335013120:12345-192.168.203.33@tcp:35:dd.0 Request processed in 211us (337us total) trans 55834578702 rc 0/0 00000100:00100000:3.0:1780809592.514410:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1837 00000100:00100000:2.0:1780809592.601415:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809592.601475:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335013376 00000100:00100000:0.0:1780809592.601485:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335013376 00000100:00100000:0.0:1780809592.601537:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7554 00000100:00100000:0.0:1780809592.601549:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:142807:x1867312335013376:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809592.601571:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809592.601625:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3ed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687239a expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.601704:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.601718:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.601728:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.601740:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.601746:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.601752:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602081:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f3eea lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602088:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f3eea lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602092:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f3eea lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809592.602099:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809592.602174:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602186:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602191:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602195:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809592.602199:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602203:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602212:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809592.602215:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809592.602220:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602226:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3edc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602244:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602252:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602257:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602262:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809592.602269:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602273:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602279:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83b00) 00010000:00010000:0.0:1780809592.602280:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809592.602282:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602286:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3ee3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602316:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3ed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687239a expref: 30 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602324:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f3eea lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687239a expref: 29 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.602328:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809592.602329:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809592.602331:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce200, rc 0) 00000100:00100000:0.0:1780809592.602374:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:142807:x1867312335013376:12345-192.168.203.33@tcp:101:dd.0 Request processed in 829us (966us total) trans 55834578703 rc 0/0 00000100:00100000:0.0:1780809592.602379:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7554 00000100:00100000:2.0:1780809592.603480:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809592.603527:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335013504 00000100:00100000:1.0:1780809592.603531:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335013504 00000100:00100000:1.0:1780809592.603559:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2173 00000100:00100000:1.0:1780809592.603564:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2393:x1867312335013504:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809592.603572:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809592.603583:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f3eea lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687239a expref: 29 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809592.603623:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809592.603626:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809592.603648:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2393:x1867312335013504:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809592.603653:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2173 00000100:00100000:2.0:1780809592.882516:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.882566:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335013760 00000100:00100000:3.0:1780809592.882574:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335013760 00000100:00100000:3.0:1780809592.882636:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1838 00000100:00100000:3.0:1780809592.882643:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:142807:x1867312335013760:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809592.882836:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:142807:x1867312335013760:12345-192.168.203.33@tcp:35:dd.0 Request processed in 192us (326us total) trans 55834578704 rc 0/0 00000100:00100000:3.0:1780809592.882842:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1838 00000100:00100000:2.0:1780809592.935725:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809592.935782:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335014016 00000100:00100000:3.0:1780809592.935790:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335014016 00000100:00100000:3.0:1780809592.935833:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7555 00000100:00100000:3.0:1780809592.935839:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:142814:x1867312335014016:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809592.935856:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809592.935873:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3ef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723a1 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.935952:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.935963:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.935972:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.935988:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.935993:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.935997:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936251:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f0d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936258:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f0d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936262:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f0d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809592.936269:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809592.936333:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936337:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936342:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936345:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809592.936348:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936359:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936368:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809592.936369:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809592.936373:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936376:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3eff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936385:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936388:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936392:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936396:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809592.936399:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936404:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936410:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809592.936413:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809592.936415:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936430:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936464:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3ef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723a1 expref: 32 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936473:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f0d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723a1 expref: 31 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809592.936478:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809592.936480:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809592.936481:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809592.936524:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:142814:x1867312335014016:12345-192.168.203.33@tcp:101:dd.0 Request processed in 686us (807us total) trans 55834578705 rc 0/0 00000100:00100000:3.0:1780809592.936528:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7555 00000100:00100000:2.0:1780809592.937532:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809592.937553:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335014144 00000100:00100000:0.0:1780809592.937558:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335014144 00000100:00100000:0.0:1780809592.937613:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2174 00000100:00100000:0.0:1780809592.937624:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2394:x1867312335014144:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809592.937641:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809592.937653:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f0d lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723a1 expref: 31 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809592.937662:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809592.937665:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809592.937687:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2394:x1867312335014144:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809592.937695:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2174 00000100:00100000:2.0:1780809593.012168:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809593.012232:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335014400 00000100:00100000:0.0:1780809593.012242:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335014400 00000100:00100000:0.0:1780809593.012300:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7556 00000100:00100000:0.0:1780809593.012312:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:142822:x1867312335014400:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809593.012335:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809593.012355:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723a8 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012423:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012436:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012446:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012458:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012476:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012483:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012830:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f3f30 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012839:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f3f30 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012846:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f3f30 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809593.012856:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809593.012952:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012960:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012966:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012972:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809593.012977:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.012985:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013006:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809593.013009:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809593.013014:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013020:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013036:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013043:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013049:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013054:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809593.013057:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013063:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013069:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83b00) 00010000:00010000:0.0:1780809593.013071:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809593.013074:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013080:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013126:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723a8 expref: 33 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013141:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f3f30 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723a8 expref: 32 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.013148:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809593.013150:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809593.013153:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfa00, rc 0) 00000100:00100000:0.0:1780809593.013205:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:142822:x1867312335014400:12345-192.168.203.33@tcp:101:dd.0 Request processed in 895us (1042us total) trans 55834578706 rc 0/0 00000100:00100000:0.0:1780809593.013213:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7556 00000100:00100000:2.0:1780809593.014208:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809593.014239:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.014254:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335014784 00000100:00100000:3.0:1780809593.014261:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335014784 00000100:00100000:1.0:1780809593.014284:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335014528 00000100:00100000:1.0:1780809593.014289:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335014528 00000100:00100000:3.0:1780809593.014303:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1839 00000100:00100000:3.0:1780809593.014313:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:142822:x1867312335014784:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809593.014326:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2175 00000100:00100000:1.0:1780809593.014337:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2393:x1867312335014528:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809593.014348:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809593.014362:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f3f30 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723a8 expref: 33 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.014378:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.014381:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809593.014408:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2393:x1867312335014528:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809593.014416:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2175 00000100:00100000:3.0:1780809593.014430:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:142822:x1867312335014784:12345-192.168.203.33@tcp:35:dd.0 Request processed in 116us (218us total) trans 55834578707 rc 0/0 00000100:00100000:3.0:1780809593.014438:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1839 00000100:00100000:2.0:1780809593.172664:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.172719:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335014912 00000100:00100000:3.0:1780809593.172727:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335014912 00000100:00100000:3.0:1780809593.172771:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7557 00000100:00100000:3.0:1780809593.172779:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:142834:x1867312335014912:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809593.172808:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809593.172824:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3f3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723af expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.172877:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.172900:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.172923:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.172933:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.172938:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.172942:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.173211:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.173219:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.173225:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.173248:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.173262:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 33 pid: 79214 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809593.173271:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338752640:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809593.173330:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780809593.174024:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338752640:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809593.174042:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809593.174165:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.174199:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335015168 00000100:00100000:3.0:1780809593.174203:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335015168 00000100:00100000:3.0:1780809593.174225:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1840 00000100:00100000:3.0:1780809593.174230:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:89645:x1867312335015168:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809593.174357:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:89645:x1867312335015168:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 126us (192us total) trans 55834578708 rc 0/0 00000100:00100000:3.0:1780809593.174363:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1840 00000100:00100000:2.0:1780809593.175013:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809593.175052:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335015296 00000100:00100000:1.0:1780809593.175061:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335015296 00010000:00010000:1.0:1780809593.175077:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 35 pid: 79214 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809593.175104:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 579 00000100:00100000:1.0:1780809593.175112:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2394:x1867312335015296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809593.175123:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809593.175129:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 35 pid: 79214 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.175139:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 35 pid: 79214 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.175151:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f3ec7 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872393 expref: 35 pid: 79214 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.175161:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.175164:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.175170:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.175173:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.175190:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809593.175210:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2394:x1867312335015296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 100us (198us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809593.175218:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809593.175225:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 579 00010000:00010000:3.0:1780809593.175228:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809593.175250:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809593.175254:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809593.175263:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175280:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175289:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175296:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175302:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175309:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.175313:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175321:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175330:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809593.175332:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.175335:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175339:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175347:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175352:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175360:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175363:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.175365:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175368:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175372:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809593.175374:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.175375:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175379:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175400:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3f3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 34 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175412:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 33 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.175419:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809593.175421:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809593.175424:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809593.175454:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:142834:x1867312335014912:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2675us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809593.175470:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7557 00000100:00100000:2.0:1780809593.176727:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809593.176760:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335015552 00000100:00100000:1.0:1780809593.176766:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335015552 00000100:00100000:1.0:1780809593.176799:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7558 00000100:00100000:1.0:1780809593.176808:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:142834:x1867312335015552:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809593.176820:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809593.176831:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723b6 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.176896:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.177124:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 34 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.177133:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.177156:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 34 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.177168:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 34 pid: 78216 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809593.177179:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338752768:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809593.177224:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc1254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780809593.177869:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338752768:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809593.177890:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809593.178057:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809593.178096:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335015680 00000100:00100000:0.0:1780809593.178102:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335015680 00010000:00010000:0.0:1780809593.178158:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 35 pid: 78216 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809593.178184:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 580 00000100:00100000:0.0:1780809593.178189:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2393:x1867312335015680:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809593.178196:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809593.178201:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 35 pid: 78216 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.178210:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 35 pid: 78216 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.178229:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f3f53 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723af expref: 35 pid: 78216 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.178237:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809593.178240:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.178245:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.178249:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.178265:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809593.178287:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2393:x1867312335015680:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809593.178292:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 580 00010000:00010000:1.0:1780809593.178295:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.178304:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809593.178315:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809593.178409:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f3f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 35 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.178423:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 34 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.178430:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.178433:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809593.178435:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64a00, rc 0) 00000100:00100000:1.0:1780809593.178464:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:142834:x1867312335015552:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1658us (1739us total) trans 55834578709 rc 0/0 00000100:00100000:1.0:1780809593.178472:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7558 00000100:00100000:2.0:1780809593.243140:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.243204:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335015936 00000100:00100000:3.0:1780809593.243219:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335015936 00000100:00100000:3.0:1780809593.243263:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1841 00000100:00100000:3.0:1780809593.243270:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:142814:x1867312335015936:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809593.243452:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:142814:x1867312335015936:12345-192.168.203.33@tcp:35:dd.0 Request processed in 182us (323us total) trans 55834578710 rc 0/0 00000100:00100000:3.0:1780809593.243457:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1841 00000100:00100000:2.0:1780809593.358954:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.359011:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335016192 00000100:00100000:3.0:1780809593.359021:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335016192 00000100:00100000:3.0:1780809593.359079:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7559 00000100:00100000:3.0:1780809593.359088:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:142843:x1867312335016192:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809593.359106:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809593.359122:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723bd expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359188:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359202:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359213:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359226:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359250:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359257:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359524:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3f84 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359531:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3f84 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359536:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3f84 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809593.359542:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809593.359635:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359641:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359646:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359649:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.359652:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359656:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359671:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809593.359673:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.359676:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359680:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359688:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359692:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359695:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359698:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.359700:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359703:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359706:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809593.359708:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.359709:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359712:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3f7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359745:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723bd expref: 38 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359753:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3f84 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723bd expref: 37 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.359758:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809593.359759:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809593.359761:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030200, rc 0) 00000100:00100000:3.0:1780809593.359803:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:142843:x1867312335016192:12345-192.168.203.33@tcp:101:dd.0 Request processed in 718us (857us total) trans 55834578711 rc 0/0 00000100:00100000:3.0:1780809593.359808:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7559 00000100:00100000:2.0:1780809593.360948:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809593.360998:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335016320 00000100:00100000:1.0:1780809593.361008:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335016320 00000100:00100000:1.0:1780809593.361034:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2176 00000100:00100000:1.0:1780809593.361039:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2394:x1867312335016320:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809593.361050:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809593.361065:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f3f84 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723bd expref: 37 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.361092:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.361096:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809593.361129:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2394:x1867312335016320:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809593.361135:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2176 00000100:00100000:2.0:1780809593.371990:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809593.372034:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335016576 00000100:00100000:0.0:1780809593.372045:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335016576 00000100:00100000:0.0:1780809593.372097:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7560 00000100:00100000:0.0:1780809593.372106:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:142849:x1867312335016576:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809593.372130:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809593.372144:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723c4 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372208:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372239:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372251:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372267:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372275:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372282:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372618:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f3fa7 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372625:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f3fa7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372630:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f3fa7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809593.372637:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809593.372709:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372716:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372723:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372734:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809593.372738:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372745:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372756:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809593.372759:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809593.372763:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372769:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f3f99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372785:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372791:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372797:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372801:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809593.372804:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372810:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372828:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83b00) 00010000:00010000:0.0:1780809593.372831:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809593.372834:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372839:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372879:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723c4 expref: 39 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372893:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f3fa7 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723c4 expref: 38 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.372900:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809593.372913:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809593.372916:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cee00, rc 0) 00000100:00100000:0.0:1780809593.372966:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142849:x1867312335016576:12345-192.168.203.33@tcp:101:dd.0 Request processed in 861us (982us total) trans 55834578712 rc 0/0 00000100:00100000:0.0:1780809593.372974:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7560 00000100:00100000:2.0:1780809593.374040:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809593.374064:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.374094:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335016960 00000100:00100000:3.0:1780809593.374100:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335016960 00000100:00100000:1.0:1780809593.374111:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335016704 00000100:00100000:1.0:1780809593.374118:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335016704 00000100:00100000:3.0:1780809593.374138:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1842 00000100:00100000:3.0:1780809593.374150:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142849:x1867312335016960:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809593.374160:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2177 00000100:00100000:1.0:1780809593.374169:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2393:x1867312335016704:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809593.374178:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809593.374189:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f3fa7 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723c4 expref: 39 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.374201:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.374210:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809593.374244:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2393:x1867312335016704:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809593.374252:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2177 00000100:00100000:3.0:1780809593.374264:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142849:x1867312335016960:12345-192.168.203.33@tcp:35:dd.0 Request processed in 115us (221us total) trans 55834578713 rc 0/0 00000100:00100000:3.0:1780809593.374273:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1842 00010000:00010000:1.0:1780809593.395732:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780809593.607702:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.607765:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335017088 00000100:00100000:3.0:1780809593.607775:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335017088 00000100:00100000:3.0:1780809593.607829:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7561 00000100:00100000:3.0:1780809593.607840:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:142856:x1867312335017088:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809593.607863:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809593.607881:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723cb expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.607960:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.607976:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.607987:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.607998:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.608002:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.608006:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.608285:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.608294:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 39 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.608299:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.608322:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 39 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.608340:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 39 pid: 77629 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809593.608350:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338752896:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809593.608407:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc5cf2300 going to sleep for 11 seconds 00000100:00100000:3.0:1780809593.609160:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338752896:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809593.609180:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809593.610137:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.610182:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335017344 00000100:00100000:3.0:1780809593.610186:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335017344 00000100:00100000:3.0:1780809593.610211:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1843 00000100:00100000:3.0:1780809593.610217:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:90168:x1867312335017344:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809593.610345:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:90168:x1867312335017344:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 128us (209us total) trans 55834578714 rc 0/0 00000100:00100000:3.0:1780809593.610350:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1843 00000100:00100000:2.0:1780809593.610946:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809593.610980:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335017472 00000100:00100000:0.0:1780809593.610985:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335017472 00010000:00010000:0.0:1780809593.611002:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 41 pid: 77629 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809593.611022:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 581 00000100:00100000:0.0:1780809593.611027:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2394:x1867312335017472:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809593.611042:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809593.611047:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 41 pid: 77629 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.611056:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 41 pid: 77629 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.611069:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f3f61 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723b6 expref: 41 pid: 77629 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.611078:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809593.611081:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.611087:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.611091:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.611105:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809593.611125:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2394:x1867312335017472:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 96us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809593.611133:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 581 00010000:00010000:3.0:1780809593.611140:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611150:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809593.611175:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809593.611179:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809593.611192:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611213:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611223:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611231:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611238:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611243:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.611248:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611256:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611265:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809593.611268:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.611272:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611278:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3fbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611294:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611300:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611311:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611317:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.611319:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611326:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611333:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809593.611335:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.611339:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611345:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611371:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 40 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611391:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 39 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.611398:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809593.611401:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809593.611403:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809593.611431:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142856:x1867312335017088:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3594us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809593.611446:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7561 00000100:00100000:2.0:1780809593.612746:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809593.612782:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335017728 00000100:00100000:0.0:1780809593.612787:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335017728 00000100:00100000:0.0:1780809593.612813:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7562 00000100:00100000:0.0:1780809593.612818:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:142856:x1867312335017728:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809593.612836:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809593.612845:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3fd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723d2 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.612891:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.612899:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 40 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.612916:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.612934:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 40 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.612943:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 40 pid: 77627 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809593.612950:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338753024:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809593.612989:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc5125240 going to sleep for 11 seconds 00000100:00100000:0.0:1780809593.613606:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338753024:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809593.613620:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809593.613871:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809593.613927:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335017856 00000100:00100000:1.0:1780809593.613932:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335017856 00010000:00010000:1.0:1780809593.613962:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 41 pid: 77627 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809593.613984:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 582 00000100:00100000:1.0:1780809593.613993:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2393:x1867312335017856:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809593.614009:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809593.614015:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 41 pid: 77627 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.614026:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 41 pid: 77627 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.614040:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f3fca lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723cb expref: 41 pid: 77627 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.614051:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.614056:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.614063:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.614070:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.614092:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809593.614095:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.614101:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809593.614116:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:1.0:1780809593.614124:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2393:x1867312335017856:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 132us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809593.614133:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 582 00010000:00010000:0.0:1780809593.614205:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f3fd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 41 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.614219:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 40 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.614224:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809593.614226:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809593.614228:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfe00, rc 0) 00000100:00100000:0.0:1780809593.614285:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:142856:x1867312335017728:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1434us (1508us total) trans 55834578715 rc 0/0 00000100:00100000:0.0:1780809593.614290:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7562 00000100:00100000:2.0:1780809593.639320:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.639365:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335018112 00000100:00100000:3.0:1780809593.639374:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335018112 00000100:00100000:3.0:1780809593.639413:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1844 00000100:00100000:3.0:1780809593.639419:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:142843:x1867312335018112:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809593.639635:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142843:x1867312335018112:12345-192.168.203.33@tcp:35:dd.0 Request processed in 214us (321us total) trans 55834578716 rc 0/0 00000100:00100000:3.0:1780809593.639640:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1844 00000100:00100000:1.0:1780809593.715768:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338753152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780809593.715827:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809593.715866:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338753152 00000100:00100000:3.0:1780809593.715874:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338753152 00000100:00100000:3.0:1780809593.715945:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1780809593.715956:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338753152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780809593.715987:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1780809593.716035:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338753152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809593.716042:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1780809593.716069:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338753152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780809593.719645:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.719687:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335018368 00000100:00100000:3.0:1780809593.719692:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335018368 00000100:00100000:3.0:1780809593.719730:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7563 00000100:00100000:3.0:1780809593.719739:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:142864:x1867312335018368:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809593.719755:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809593.719773:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723d9 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.719833:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.719858:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.719869:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.719888:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.719896:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.719914:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720233:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3ffb lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720243:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3ffb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720250:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3ffb lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809593.720259:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809593.720341:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720349:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720355:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720367:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.720371:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720378:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720389:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809593.720392:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.720397:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720403:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f3fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720415:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720421:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720427:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720431:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809593.720434:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720439:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720456:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809593.720458:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809593.720461:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720467:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f3ff4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720503:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f3fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d9 expref: 44 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720516:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3ffb lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d9 expref: 43 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809593.720524:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809593.720526:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809593.720529:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809593.720573:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:142864:x1867312335018368:12345-192.168.203.33@tcp:101:dd.0 Request processed in 835us (928us total) trans 55834578717 rc 0/0 00000100:00100000:3.0:1780809593.720580:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7563 00000100:00100000:2.0:1780809593.721640:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809593.721680:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335018496 00000100:00100000:1.0:1780809593.721684:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335018496 00000100:00100000:1.0:1780809593.721719:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2178 00000100:00100000:1.0:1780809593.721724:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2394:x1867312335018496:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809593.721731:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809593.721749:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f3ffb lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d9 expref: 43 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.721759:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.721762:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809593.721784:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2394:x1867312335018496:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809593.721789:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2178 00000100:00100000:2.0:1780809593.764273:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809593.764322:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335018752 00000100:00100000:1.0:1780809593.764330:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335018752 00000100:00100000:1.0:1780809593.764369:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7564 00000100:00100000:1.0:1780809593.764376:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:142870:x1867312335018752:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809593.764393:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809593.764408:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723e0 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764461:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764472:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764481:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764489:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764503:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764508:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764832:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f401e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764842:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f401e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764851:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f401e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809593.764860:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809593.764949:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764955:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764959:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764963:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809593.764966:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764971:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764985:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809593.764987:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809593.764991:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.764994:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765002:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765005:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765008:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765011:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809593.765013:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765016:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765020:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809593.765021:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809593.765022:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765025:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4017 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765059:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e0 expref: 45 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765068:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f401e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e0 expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809593.765073:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809593.765074:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809593.765076:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64a00, rc 0) 00000100:00100000:1.0:1780809593.765121:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142870:x1867312335018752:12345-192.168.203.33@tcp:101:dd.0 Request processed in 746us (854us total) trans 55834578718 rc 0/0 00000100:00100000:1.0:1780809593.765128:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7564 00000100:00100000:2.0:1780809593.766060:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809593.766091:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335018880 00000100:00100000:0.0:1780809593.766095:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335018880 00000100:00100000:2.0:1780809593.766096:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809593.766128:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2179 00000100:00100000:3.0:1780809593.766137:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335019136 00000100:00100000:3.0:1780809593.766141:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335019136 00000100:00100000:0.0:1780809593.766173:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2393:x1867312335018880:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809593.766180:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1845 00010000:00010000:0.0:1780809593.766186:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809593.766192:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:142870:x1867312335019136:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:0.0:1780809593.766200:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f401e lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e0 expref: 45 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809593.766209:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809593.766212:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809593.766238:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2393:x1867312335018880:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809593.766249:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2179 00000100:00100000:3.0:1780809593.766303:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142870:x1867312335019136:12345-192.168.203.33@tcp:35:dd.0 Request processed in 113us (204us total) trans 55834578719 rc 0/0 00000100:00100000:3.0:1780809593.766311:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1845 00000100:00100000:2.0:1780809593.989404:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809593.989454:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335019392 00000100:00100000:3.0:1780809593.989463:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335019392 00000100:00100000:3.0:1780809593.989507:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1846 00000100:00100000:3.0:1780809593.989518:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:142864:x1867312335019392:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809593.989719:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:142864:x1867312335019392:12345-192.168.203.33@tcp:35:dd.0 Request processed in 204us (324us total) trans 55834578720 rc 0/0 00000100:00100000:3.0:1780809593.989726:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1846 00000100:00100000:2.0:1780809594.137438:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809594.137497:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335019520 00000100:00100000:3.0:1780809594.137507:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335019520 00000100:00080000:1.0:1780809594.137560:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809594.137565:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7565 00000100:00100000:3.0:1780809594.137574:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:142885:x1867312335019520:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809594.137622:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809594.137638:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f402c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723e7 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137686:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137696:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137703:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137711:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137716:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137733:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137987:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.137995:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 46 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.138001:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.138023:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 46 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.138031:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 46 pid: 80225 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809594.138041:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338753280:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809594.138097:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc73089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809594.138767:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338753280:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809594.138783:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809594.138914:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809594.138948:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335019776 00000100:00100000:3.0:1780809594.138951:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335019776 00000100:00100000:3.0:1780809594.138975:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1847 00000100:00100000:3.0:1780809594.138980:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:89645:x1867312335019776:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809594.139108:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:89645:x1867312335019776:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 128us (196us total) trans 55834578721 rc 0/0 00000100:00100000:3.0:1780809594.139114:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1847 00000100:00100000:2.0:1780809594.139696:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.139736:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335019904 00000100:00100000:1.0:1780809594.139741:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335019904 00010000:00010000:1.0:1780809594.139758:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 48 pid: 80225 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.139782:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 583 00000100:00100000:1.0:1780809594.139790:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2394:x1867312335019904:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809594.139799:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809594.139805:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 48 pid: 80225 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.139817:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 48 pid: 80225 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.139846:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f3fd8 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723d2 expref: 48 pid: 80225 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.139864:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.139867:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.139880:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.139885:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.139912:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809594.139935:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2394:x1867312335019904:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 146us (238us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809594.139939:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.139942:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 583 00010000:00010000:3.0:1780809594.139950:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809594.139971:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809594.139975:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809594.139985:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.139994:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140000:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140004:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140009:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140012:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809594.140014:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140019:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140031:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809594.140033:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809594.140036:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140039:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140048:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140051:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140055:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140059:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809594.140060:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140063:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140067:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809594.140068:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809594.140070:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140073:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f403a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140097:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f402c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 47 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140104:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 46 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.140109:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809594.140110:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809594.140112:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030400, rc 0) 00000100:00100000:3.0:1780809594.140136:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:142885:x1867312335019520:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2564us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809594.140140:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7565 00000100:00100000:2.0:1780809594.141212:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809594.141238:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335020160 00000100:00100000:0.0:1780809594.141243:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335020160 00000100:00100000:0.0:1780809594.141267:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7566 00000100:00100000:0.0:1780809594.141272:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc4135450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:142885:x1867312335020160:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809594.141280:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809594.141288:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723ee expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.141327:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.141334:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 47 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.141339:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.141360:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 47 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.141367:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 47 pid: 79214 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809594.141373:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338753408:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809594.141412:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397000 going to sleep for 11 seconds 00000100:00100000:0.0:1780809594.142020:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338753408:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809594.142038:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809594.142167:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.142202:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335020288 00000100:00100000:1.0:1780809594.142206:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335020288 00010000:00010000:1.0:1780809594.142218:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 48 pid: 79214 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.142237:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 584 00000100:00100000:1.0:1780809594.142241:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2394:x1867312335020288:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809594.142247:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809594.142251:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 48 pid: 79214 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.142267:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 48 pid: 79214 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.142277:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4041 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723e7 expref: 48 pid: 79214 timeout: 1956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.142284:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.142287:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.142292:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.142296:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.142308:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809594.142323:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.142330:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2394:x1867312335020288:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 86us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809594.142332:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.142339:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 584 00000004:00200000:0.0:1780809594.142346:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809594.142419:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 48 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.142434:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 47 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.142441:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809594.142443:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809594.142479:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce000, rc 0) 00000100:00100000:0.0:1780809594.142504:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc4135450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142885:x1867312335020160:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1232us (1293us total) trans 55834578722 rc 0/0 00000100:00100000:0.0:1780809594.142508:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7566 00000100:00100000:2.0:1780809594.217050:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809594.217108:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335020544 00000100:00100000:3.0:1780809594.217116:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335020544 00000100:00100000:3.0:1780809594.217158:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7567 00000100:00100000:3.0:1780809594.217169:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:142898:x1867312335020544:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809594.217191:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809594.217210:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f405d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723f5 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217272:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217286:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217297:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217324:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217331:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217338:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217674:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4072 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217683:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4072 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217689:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4072 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809594.217698:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809594.217770:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217777:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217783:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217789:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809594.217792:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217809:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217820:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809594.217822:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809594.217827:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217833:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217845:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217851:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217858:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217863:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809594.217865:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217876:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217883:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809594.217885:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809594.217887:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217914:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f406b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217955:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f405d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723f5 expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217964:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4072 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723f5 expref: 49 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.217969:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809594.217970:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809594.217972:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030400, rc 0) 00000100:00100000:3.0:1780809594.218012:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:142898:x1867312335020544:12345-192.168.203.33@tcp:101:dd.0 Request processed in 847us (972us total) trans 55834578723 rc 0/0 00000100:00100000:3.0:1780809594.218017:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7567 00000100:00100000:2.0:1780809594.219042:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809594.219061:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.219100:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335020928 00000100:00100000:0.0:1780809594.219104:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335020672 00000100:00100000:1.0:1780809594.219106:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335020928 00000100:00100000:0.0:1780809594.219111:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335020672 00000100:00100000:1.0:1780809594.219137:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7568 00000100:00100000:1.0:1780809594.219144:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142897:x1867312335020928:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809594.219154:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1780809594.219161:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2180 00010000:00010000:1.0:1780809594.219162:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468723fc expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809594.219175:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2394:x1867312335020672:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809594.219188:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809594.219203:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4072 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723f5 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219213:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219229:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.219235:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.219237:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.219241:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809594.219248:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219254:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219258:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809594.219271:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2394:x1867312335020672:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 100us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809594.219277:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2180 00010000:00010000:1.0:1780809594.219451:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4095 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219457:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4095 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219462:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4095 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809594.219466:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809594.219500:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219511:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219515:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219518:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809594.219520:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219524:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219529:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809594.219531:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809594.219533:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219536:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219542:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219545:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219549:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219552:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809594.219556:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219560:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219564:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809594.219565:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809594.219567:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219570:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f408e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219612:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723fc expref: 51 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219622:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4095 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723fc expref: 50 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.219626:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.219628:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809594.219629:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64c00, rc 0) 00000100:00100000:1.0:1780809594.219653:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142897:x1867312335020928:12345-192.168.203.33@tcp:101:dd.0 Request processed in 511us (592us total) trans 55834578724 rc 0/0 00000100:00100000:1.0:1780809594.219658:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7568 00000100:00100000:2.0:1780809594.220560:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809594.220605:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.220617:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335021056 00000100:00100000:1.0:1780809594.220621:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335021056 00000100:00100000:3.0:1780809594.220641:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335021312 00000100:00100000:3.0:1780809594.220648:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335021312 00000100:00100000:1.0:1780809594.220649:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2181 00000100:00100000:1.0:1780809594.220658:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2391:x1867312335021056:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809594.220671:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809594.220681:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4095 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723fc expref: 51 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809594.220688:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1848 00010000:00010000:1.0:1780809594.220691:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.220695:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809594.220700:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142897:x1867312335021312:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809594.220720:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2391:x1867312335021056:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 63us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.220725:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2181 00000100:00100000:3.0:1780809594.220798:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142897:x1867312335021312:12345-192.168.203.33@tcp:35:dd.0 Request processed in 103us (208us total) trans 55834578725 rc 0/0 00000100:00100000:3.0:1780809594.220804:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1848 00010000:00010000:1.0:1780809594.419763:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780809594.465108:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809594.465165:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335021568 00000100:00100000:3.0:1780809594.465175:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335021568 00000100:00100000:3.0:1780809594.465236:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7569 00000100:00100000:3.0:1780809594.465247:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:142905:x1867312335021568:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809594.465279:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809594.465296:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f40a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872403 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465359:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465373:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465382:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465393:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465399:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465406:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465764:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f40b8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465773:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f40b8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465780:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f40b8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809594.465789:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809594.465874:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465879:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465884:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465887:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809594.465890:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465908:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465917:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809594.465919:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809594.465922:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465926:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f40aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465934:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465938:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465941:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465951:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809594.465954:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465960:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465967:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809594.465970:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809594.465972:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.465979:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f40b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.466014:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f40a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872403 expref: 53 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.466026:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f40b8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872403 expref: 52 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809594.466034:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809594.466036:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809594.466039:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809594.466085:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142905:x1867312335021568:12345-192.168.203.33@tcp:101:dd.0 Request processed in 841us (984us total) trans 55834578726 rc 0/0 00000100:00100000:3.0:1780809594.466090:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7569 00000100:00100000:2.0:1780809594.467055:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809594.467093:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.467101:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335021696 00000100:00100000:1.0:1780809594.467106:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335021696 00000100:00100000:3.0:1780809594.467133:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335021952 00000100:00100000:1.0:1780809594.467140:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2182 00000100:00100000:3.0:1780809594.467145:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335021952 00000100:00100000:1.0:1780809594.467150:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2393:x1867312335021696:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809594.467160:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809594.467172:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f40b8 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872403 expref: 53 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.467184:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.467189:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809594.467190:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1849 00000100:00100000:3.0:1780809594.467203:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142905:x1867312335021952:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809594.467216:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2393:x1867312335021696:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.467222:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2182 00000100:00100000:3.0:1780809594.467305:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142905:x1867312335021952:12345-192.168.203.33@tcp:35:dd.0 Request processed in 106us (210us total) trans 55834578727 rc 0/0 00000100:00100000:3.0:1780809594.467314:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1849 00000100:00100000:2.0:1780809594.518916:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809594.518978:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335022208 00000100:00100000:3.0:1780809594.518987:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335022208 00000100:00100000:3.0:1780809594.519029:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1850 00000100:00100000:3.0:1780809594.519035:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:142898:x1867312335022208:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809594.519206:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:142898:x1867312335022208:12345-192.168.203.33@tcp:35:dd.0 Request processed in 171us (296us total) trans 55834578728 rc 0/0 00000100:00100000:3.0:1780809594.519212:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1850 00000100:00100000:2.0:1780809594.606198:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.606244:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335022464 00000100:00100000:1.0:1780809594.606253:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335022464 00000100:00100000:1.0:1780809594.606295:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7570 00000100:00100000:1.0:1780809594.606302:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:142913:x1867312335022464:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809594.606330:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809594.606345:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f40c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687240a expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606403:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606414:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606421:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606430:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606434:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606438:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606698:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f40db lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606705:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f40db lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606709:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f40db lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809594.606716:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809594.606792:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606797:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606801:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606804:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809594.606808:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606812:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606820:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809594.606822:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809594.606825:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606828:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606836:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606840:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606844:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606853:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809594.606855:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606858:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606862:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:1.0:1780809594.606864:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809594.606865:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606868:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606914:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f40c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687240a expref: 56 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606927:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f40db lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687240a expref: 55 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.606934:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.606935:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809594.606937:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64400, rc 0) 00000100:00100000:1.0:1780809594.606980:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142913:x1867312335022464:12345-192.168.203.33@tcp:101:dd.0 Request processed in 679us (790us total) trans 55834578729 rc 0/0 00000100:00100000:1.0:1780809594.606985:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7570 00000100:00100000:2.0:1780809594.608204:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809594.608251:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335022592 00000100:00100000:0.0:1780809594.608255:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335022592 00000100:00100000:0.0:1780809594.608285:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2183 00000100:00100000:0.0:1780809594.608291:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5525c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2394:x1867312335022592:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809594.608301:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809594.608311:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f40db lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687240a expref: 55 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.608321:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809594.608323:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809594.608352:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5525c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2394:x1867312335022592:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809594.608361:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2183 00000100:00100000:3.0:1780809594.739758:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338753664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780809594.739758:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3442:1867312338753792:0@lo:400:kworker.0 00000100:00100000:3.0:1780809594.739837:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809594.739837:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809594.739838:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338753920:0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.739880:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809594.739886:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338754304:0@lo:400:kworker.0 00000100:00100000:3.0:1780809594.739888:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338754048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780809594.739922:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338754432:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.739934:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809594.739940:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809594.739959:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809594.739965:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338753664 00000100:00100000:1.0:1780809594.739966:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338754816:0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.739974:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338753664 00000100:00100000:3.0:1780809594.739979:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338754560:0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.739991:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338754944:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.739992:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809594.740018:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809594.740023:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1867312338755328:0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.740030:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809594.740031:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754048 00000100:00100000:2.0:1780809594.740035:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754048 00000100:00100000:3.0:1780809594.740046:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1867312338755072:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740062:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809594.740063:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338755456:0@lo:400:kworker.0 00000100:00100000:3.0:1780809594.740087:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338753536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809594.740114:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1780809594.740117:0:77620:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338753792 00000100:00100000:1.0:1780809594.740123:0:77620:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338753792 00000100:00100000:3.0:1780809594.740124:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809594.740128:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338753664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780809594.740128:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338753920 00000100:00100000:0.0:1780809594.740133:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338753920 00000100:00100000:3.0:1780809594.740146:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338754176:0@lo:400:kworker.0 00002000:00000024:2.0:1780809594.740157:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:1.0:1780809594.740157:0:77620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1780809594.740168:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754560 00000100:00100000:1.0:1780809594.740169:0:77620:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf4fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3442:x1867312338753792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.740172:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754560 00000100:00100000:3.0:1780809594.740178:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809594.740195:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1780809594.740207:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338753664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809594.740207:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338753920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740216:0:77620:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf4fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3442:x1867312338753792:12345-0@lo:400:kworker.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809594.740217:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1780809594.740220:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338754688:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740229:0:77620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1780809594.740236:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338753536 00000100:00100000:2.0:1780809594.740240:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338753536 00000100:00100000:0.0:1780809594.740252:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338753920:12345-0@lo:400:kworker.0 Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809594.740264:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809594.740265:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00080000:1.0:1780809594.740265:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780809594.740265:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00080000:1.0:1780809594.740273:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780809594.740276:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338754048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780809594.740285:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:3.0:1780809594.740294:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3445:1867312338755200:0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.740295:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1780809594.740301:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3442:1867312338753792:0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.740311:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338754560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.740325:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338754048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.740328:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754432 00000100:00100000:1.0:1780809594.740331:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754432 00000100:00100000:2.0:1780809594.740332:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1780809594.740336:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809594.740356:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1780809594.740356:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338754560:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.740362:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754944 00000100:00100000:0.0:1780809594.740366:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1780809594.740367:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338753536:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780809594.740367:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754944 00002000:00000024:2.0:1780809594.740386:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:3.0:1780809594.740387:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754304 00000100:00100000:3.0:1780809594.740393:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754304 00000100:00100000:1.0:1780809594.740394:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338755328 00000100:00100000:1.0:1780809594.740398:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338755328 00000100:00100000:0.0:1780809594.740407:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809594.740425:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338755200 00000100:00100000:1.0:1780809594.740428:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338755200 00000100:00100000:2.0:1780809594.740431:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338753536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809594.740436:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754816 00000100:00100000:2.0:1780809594.740437:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1780809594.740442:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754816 00000100:00100000:1.0:1780809594.740444:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338755456 00000100:00100000:0.0:1780809594.740444:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338753920:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740449:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338755456 00000100:00100000:2.0:1780809594.740473:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754176 00000100:00100000:3.0:1780809594.740475:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338754688 00000100:00100000:2.0:1780809594.740477:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754176 00000100:00100000:1.0:1780809594.740478:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1780809594.740481:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338754688 00000100:00100000:0.0:1780809594.740495:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1780809594.740496:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338754432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.740505:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1780809594.740510:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338754944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809594.740515:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1780809594.740518:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338754304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809594.740528:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338754816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740542:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338754432:12345-0@lo:400:kworker.0 Request processed in 50us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809594.740547:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338754432:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740548:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1780809594.740560:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338754304:12345-0@lo:400:kworker.0 Request processed in 45us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809594.740567:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1780809594.740574:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1780809594.740582:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338754816:12345-0@lo:400:kworker.0 Request processed in 55us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.740586:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1867312338755328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.740602:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1780809594.740607:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1780809594.740614:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3445:x1867312338755200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809594.740620:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1780809594.740621:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338754176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740627:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1867312338755328:12345-0@lo:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.740632:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1780809594.740648:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1780809594.740652:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1780809594.740657:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3445:x1867312338755200:12345-0@lo:400:kworker.0 Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809594.740663:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338754688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.740663:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338754176:12345-0@lo:400:kworker.0 Request processed in 43us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.740664:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338755456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.740675:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1780809594.740678:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1780809594.740718:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338755456:12345-0@lo:400:kworker.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809594.740725:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338754688:12345-0@lo:400:kworker.0 Request processed in 66us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.740727:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00010000:00080000:0.0:1780809594.740732:0:3443:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadfd791180 x1867312338755456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780809594.740740:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00080000:1.0:1780809594.740744:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780809594.740749:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780809594.740753:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809594.740755:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338755456:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740775:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338754816:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740784:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1867312338755328:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740795:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338754304:0@lo:400:kworker.0 00000100:00100000:0.0:1780809594.740815:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338754944:12345-0@lo:400:kworker.0 Request processed in 310us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809594.740824:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809594.740826:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1780809594.740842:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338754944:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.740870:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338755072 00000100:00100000:1.0:1780809594.740873:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338755072 00000100:00100000:3.0:1780809594.740874:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338753664:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1780809594.740906:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809594.740910:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338754048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780809594.740939:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1780809594.740955:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338754560:0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.740957:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338753536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780809594.740957:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1867312338755072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.741000:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338754176:0@lo:400:kworker.0 00000100:00100000:1.0:1780809594.741017:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1867312338755072:12345-0@lo:400:kworker.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.741024:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1780809594.741043:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1867312338755072:0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.741053:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338754688:0@lo:400:kworker.0 00010000:00080000:2.0:1780809594.741071:0:3445:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadfd793480 x1867312338755200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809594.741084:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3445:1867312338755200:0@lo:400:kworker.0 00000100:00100000:2.0:1780809594.770556:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.770624:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335022720 00000100:00100000:1.0:1780809594.770636:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335022720 00000100:00100000:1.0:1780809594.770678:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7571 00000100:00100000:1.0:1780809594.770685:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:142919:x1867312335022720:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809594.770704:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809594.770717:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f40e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872411 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.770763:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.770774:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.770782:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.770790:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.770794:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.770798:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.771079:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.771087:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 55 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.771093:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.771116:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 55 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.771127:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 55 pid: 77628 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.771140:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338755584:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809594.771208:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd08e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1780809594.771943:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338755584:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809594.771960:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809594.772014:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809594.772070:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335022976 00000100:00100000:3.0:1780809594.772076:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335022976 00000100:00100000:3.0:1780809594.772110:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1851 00000100:00100000:3.0:1780809594.772119:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:90168:x1867312335022976:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809594.772247:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:90168:x1867312335022976:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 130us (234us total) trans 55834578730 rc 0/0 00000100:00100000:3.0:1780809594.772252:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1851 00000100:00100000:2.0:1780809594.772915:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.772949:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335023104 00000100:00100000:1.0:1780809594.772953:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335023104 00010000:00010000:1.0:1780809594.772966:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 57 pid: 77628 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.772984:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 585 00000100:00100000:1.0:1780809594.772995:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312335023104:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809594.773002:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809594.773006:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 57 pid: 77628 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.773014:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 57 pid: 77628 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.773025:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f404f lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468723ee expref: 57 pid: 77628 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.773039:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.773042:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.773046:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.773050:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.773065:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809594.773081:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.773087:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2393:x1867312335023104:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 91us (172us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809594.773093:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.773096:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 585 00000004:00200000:2.0:1780809594.773120:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809594.773124:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809594.773135:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773144:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773150:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773154:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773159:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773163:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809594.773166:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773180:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773187:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809594.773189:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809594.773191:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773195:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f40f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773202:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773206:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773209:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773212:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809594.773214:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773217:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773220:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479fe00) 00010000:00010000:2.0:1780809594.773221:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809594.773223:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773232:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f40f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773253:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f40e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 56 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773262:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 55 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809594.773267:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809594.773268:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809594.773270:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:2.0:1780809594.773298:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142919:x1867312335022720:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2614us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809594.773302:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7571 00000100:00100000:2.0:1780809594.774721:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809594.774760:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335023360 00000100:00100000:0.0:1780809594.774765:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335023360 00000100:00100000:0.0:1780809594.774796:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7572 00000100:00100000:0.0:1780809594.774802:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:142919:x1867312335023360:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809594.774814:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809594.774821:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872418 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.774881:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.774907:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 56 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.774916:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.774939:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 56 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.774951:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 56 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809594.774976:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338755712:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809594.775022:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc5cf2300 going to sleep for 11 seconds 00000100:00100000:0.0:1780809594.775730:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338755712:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809594.775745:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809594.775758:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809594.775782:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335023488 00000100:00100000:1.0:1780809594.775786:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335023488 00010000:00010000:1.0:1780809594.775799:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 57 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.775830:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 586 00000100:00100000:1.0:1780809594.775836:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2394:x1867312335023488:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809594.775843:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809594.775847:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 57 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.775861:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 57 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.775872:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f40fe lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872411 expref: 57 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.775879:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809594.775882:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.775887:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.775899:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809594.775912:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809594.775932:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809594.775934:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2394:x1867312335023488:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809594.775949:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 586 00010000:00010000:0.0:1780809594.775950:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809594.775963:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809594.776081:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 57 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.776099:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 56 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.776107:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809594.776110:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809594.776112:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cea00, rc 0) 00000100:00100000:0.0:1780809594.776143:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142919:x1867312335023360:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1340us (1421us total) trans 55834578731 rc 0/0 00000100:00100000:0.0:1780809594.776151:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7572 00000100:00100000:2.0:1780809594.879220:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809594.879273:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335023744 00000100:00100000:3.0:1780809594.879281:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335023744 00000100:00100000:3.0:1780809594.879321:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1852 00000100:00100000:3.0:1780809594.879328:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:142913:x1867312335023744:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809594.879499:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142913:x1867312335023744:12345-192.168.203.33@tcp:35:dd.0 Request processed in 170us (285us total) trans 55834578732 rc 0/0 00000100:00100000:3.0:1780809594.879506:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1852 00000100:00100000:3.0:1780809594.943489:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809594.943546:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335024000 00000100:00100000:0.0:1780809594.943569:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335024000 00000100:00100000:0.0:1780809594.943645:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7573 00000100:00100000:0.0:1780809594.943659:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:142927:x1867312335024000:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809594.943682:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809594.943704:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f411a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687241f expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.943772:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.943786:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.943798:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.943812:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.943821:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.943828:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944209:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f412f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944220:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f412f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944229:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f412f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809594.944248:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809594.944336:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944346:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944354:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944361:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809594.944366:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944375:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944388:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809594.944392:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809594.944397:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944404:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944422:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944429:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944447:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944454:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfc00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809594.944458:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944466:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944475:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83b00) 00010000:00010000:0.0:1780809594.944478:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809594.944481:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944488:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f4128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944530:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f411a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687241f expref: 60 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944547:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f412f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687241f expref: 59 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.944556:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809594.944559:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809594.944561:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce000, rc 0) 00000100:00100000:0.0:1780809594.944649:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142927:x1867312335024000:12345-192.168.203.33@tcp:101:dd.0 Request processed in 993us (1166us total) trans 55834578733 rc 0/0 00000100:00100000:0.0:1780809594.944669:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7573 00000100:00100000:2.0:1780809594.945790:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809594.945821:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335024128 00000100:00100000:0.0:1780809594.945826:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335024128 00000100:00100000:0.0:1780809594.945856:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2184 00000100:00100000:0.0:1780809594.945863:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2393:x1867312335024128:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809594.945873:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809594.945889:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f412f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687241f expref: 59 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809594.945917:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809594.945922:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809594.945956:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2393:x1867312335024128:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809594.945962:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2184 00000100:00100000:2.0:1780809595.006669:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809595.006720:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335024256 00000100:00100000:0.0:1780809595.006729:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335024256 00000100:00100000:0.0:1780809595.006775:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7574 00000100:00100000:0.0:1780809595.006784:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:142933:x1867312335024256:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809595.006804:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809595.006821:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f413d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872426 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.006881:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.006906:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.006930:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.006941:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.006947:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.006951:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.007233:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.007246:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 59 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.007255:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.007291:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 59 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809595.007307:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 59 pid: 80225 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809595.007323:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338755840:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809595.007392:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397000 going to sleep for 11 seconds 00000100:00100000:2.0:1780809595.008288:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd791180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338755840:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809595.008304:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.008541:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.008615:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335024512 00000100:00100000:3.0:1780809595.008621:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335024512 00000100:00100000:3.0:1780809595.008651:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1853 00000100:00100000:3.0:1780809595.008659:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:90168:x1867312335024512:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809595.008803:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:90168:x1867312335024512:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 146us (263us total) trans 55834578734 rc 0/0 00000100:00100000:3.0:1780809595.008809:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1853 00000100:00100000:0.0:1780809595.009630:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.009690:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335024640 00000100:00100000:1.0:1780809595.009704:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335024640 00010000:00010000:1.0:1780809595.009728:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 61 pid: 80225 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.009760:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 587 00000100:00100000:1.0:1780809595.009768:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2394:x1867312335024640:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809595.009779:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809595.009786:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 61 pid: 80225 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.009801:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 61 pid: 80225 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.009821:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cea00/0x25b625638c8f410c lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872418 expref: 61 pid: 80225 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.009842:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.009847:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.009856:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.009864:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.009907:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809595.009926:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.009946:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.009948:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2394:x1867312335024640:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 178us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809595.009975:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 587 00000004:00200000:2.0:1780809595.009977:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809595.009982:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809595.009994:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010003:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010011:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010016:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010021:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010025:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809595.010029:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010034:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010042:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809595.010044:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809595.010047:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010059:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf400/0x25b625638c8f4144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010070:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010073:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010077:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010081:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfc00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809595.010083:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010086:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010091:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83b00) 00010000:00010000:2.0:1780809595.010093:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809595.010095:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010098:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfc00/0x25b625638c8f414b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010121:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce000/0x25b625638c8f413d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 60 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010140:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 59 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.010146:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.010148:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809595.010149:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce400, rc 0) 00000100:00100000:2.0:1780809595.010182:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142933:x1867312335024256:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3398us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809595.010190:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7574 00000100:00100000:0.0:1780809595.011647:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.011696:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335024896 00000100:00100000:3.0:1780809595.011703:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335024896 00000100:00100000:3.0:1780809595.011740:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7575 00000100:00100000:3.0:1780809595.011762:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:142933:x1867312335024896:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809595.011775:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809595.011787:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687242d expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.011846:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.011859:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 60 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.011865:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.011907:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 60 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.011921:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 60 pid: 77627 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809595.011938:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338755968:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809595.011984:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc73089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809595.013260:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338755968:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809595.013273:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809595.013492:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.013529:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335025024 00000100:00100000:1.0:1780809595.013535:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335025024 00010000:00010000:1.0:1780809595.013550:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 61 pid: 77627 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.013573:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 588 00000100:00100000:1.0:1780809595.013579:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2393:x1867312335025024:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809595.013602:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809595.013607:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 61 pid: 77627 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.013616:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 61 pid: 77627 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.013628:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce400/0x25b625638c8f4152 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872426 expref: 61 pid: 77627 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.013638:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.013641:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.013647:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.013651:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.013674:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809595.013699:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.013701:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2393:x1867312335025024:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809595.013711:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 588 00010000:00010000:3.0:1780809595.013720:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809595.013730:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809595.013804:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 61 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.013815:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 60 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.013821:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809595.013823:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809595.013825:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809595.013852:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:142933:x1867312335024896:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2095us (2206us total) trans 55834578735 rc 0/0 00000100:00100000:3.0:1780809595.013856:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7575 00000100:00100000:0.0:1780809595.107318:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.107383:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335025280 00000100:00100000:1.0:1780809595.107395:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335025280 00000100:00100000:1.0:1780809595.107446:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7576 00000100:00100000:1.0:1780809595.107456:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:142947:x1867312335025280:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809595.107477:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809595.107493:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f416e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872434 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107551:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107569:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107577:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107616:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107622:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107627:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107972:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4183 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107980:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4183 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.107985:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4183 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809595.108000:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809595.108073:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108079:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108083:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108087:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809595.108090:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108095:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108104:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809595.108106:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809595.108109:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108121:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108131:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108134:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108138:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108142:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809595.108144:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108148:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108155:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:1.0:1780809595.108157:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809595.108160:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108166:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f417c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108209:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f416e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872434 expref: 63 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108230:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4183 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872434 expref: 62 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.108235:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.108237:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809595.108239:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65a00, rc 0) 00000100:00100000:1.0:1780809595.108289:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142947:x1867312335025280:12345-192.168.203.33@tcp:101:dd.0 Request processed in 836us (980us total) trans 55834578736 rc 0/0 00000100:00100000:1.0:1780809595.108295:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7576 00000100:00100000:0.0:1780809595.109443:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809595.109487:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809595.109497:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335025408 00000100:00100000:2.0:1780809595.109504:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335025408 00000100:00100000:3.0:1780809595.109537:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335025664 00000100:00100000:3.0:1780809595.109544:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335025664 00000100:00100000:2.0:1780809595.109550:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2185 00000100:00100000:2.0:1780809595.109564:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2391:x1867312335025408:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809595.109585:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809595.109620:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1854 00010000:00010000:2.0:1780809595.109631:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4183 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872434 expref: 63 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809595.109636:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142947:x1867312335025664:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809595.109650:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.109654:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809595.109683:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:2391:x1867312335025408:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 125us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809595.109688:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2185 00000100:00100000:3.0:1780809595.109792:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142947:x1867312335025664:12345-192.168.203.33@tcp:35:dd.0 Request processed in 162us (303us total) trans 55834578737 rc 0/0 00000100:00100000:3.0:1780809595.109801:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1854 00000100:00100000:2.0:1780809595.251799:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338756096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780809595.251876:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809595.251959:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338756096 00000100:00100000:0.0:1780809595.251967:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338756096 00000100:00100000:0.0:1780809595.252015:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1780809595.252025:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338756096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780809595.252066:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:0.0:1780809595.252131:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338756096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809595.252140:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1780809595.252163:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338756096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780809595.278070:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.278140:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335025920 00000100:00100000:3.0:1780809595.278150:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335025920 00000100:00100000:3.0:1780809595.278199:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1855 00000100:00100000:3.0:1780809595.278220:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:142927:x1867312335025920:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809595.278433:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142927:x1867312335025920:12345-192.168.203.33@tcp:35:dd.0 Request processed in 212us (371us total) trans 55834578738 rc 0/0 00000100:00100000:3.0:1780809595.278442:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1855 00000100:00100000:2.0:1780809595.341746:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.341809:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335026048 00000100:00100000:1.0:1780809595.341820:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335026048 00000100:00100000:1.0:1780809595.341884:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7577 00000100:00100000:1.0:1780809595.341911:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:142955:x1867312335026048:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809595.341935:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809595.341951:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687243b expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342004:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342015:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342024:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342034:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342051:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342056:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342335:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342344:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 64 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342350:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342376:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 64 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.342386:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 64 pid: 79214 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.342397:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338756224:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809595.342458:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd511b000 going to sleep for 11 seconds 00000100:00100000:1.0:1780809595.343355:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338756224:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809595.343373:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.343615:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.343699:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335026304 00000100:00100000:3.0:1780809595.343705:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335026304 00000100:00100000:3.0:1780809595.343734:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1856 00000100:00100000:3.0:1780809595.343740:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:90168:x1867312335026304:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809595.343907:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:90168:x1867312335026304:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 165us (315us total) trans 55834578739 rc 0/0 00000100:00100000:3.0:1780809595.343915:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1856 00000100:00100000:0.0:1780809595.344633:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.344672:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335026432 00000100:00100000:1.0:1780809595.344683:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335026432 00010000:00010000:1.0:1780809595.344701:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 66 pid: 79214 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.344725:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 589 00000100:00100000:1.0:1780809595.344730:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2394:x1867312335026432:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809595.344738:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809595.344743:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 66 pid: 79214 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.344752:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 66 pid: 79214 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.344765:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4160 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687242d expref: 66 pid: 79214 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.344777:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.344781:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.344788:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.344793:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.344809:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809595.344829:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.344836:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2394:x1867312335026432:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 103us (203us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809595.344843:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.344863:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 589 00000004:00200000:2.0:1780809595.344882:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809595.344899:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809595.344919:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.344932:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.344943:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.344948:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.344953:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.344957:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809595.344961:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.344968:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.344993:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809595.344996:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809595.345001:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345007:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f4198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345020:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345028:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345034:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345040:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809595.345043:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345050:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345065:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f700) 00010000:00010000:2.0:1780809595.345068:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809595.345071:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345078:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f419f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345126:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345138:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 64 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.345146:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.345149:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809595.345151:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65c00, rc 0) 00000100:00100000:2.0:1780809595.345190:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142955:x1867312335026048:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3282us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809595.345199:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7577 00000100:00100000:0.0:1780809595.346537:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.346571:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335026688 00000100:00100000:1.0:1780809595.346576:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335026688 00000100:00100000:1.0:1780809595.346620:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7578 00000100:00100000:1.0:1780809595.346626:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:142955:x1867312335026688:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809595.346636:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809595.346644:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f41ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872442 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.346689:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.346697:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.346702:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.346715:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 65 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.346723:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 65 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.346730:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338756352:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809595.346765:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd511bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1780809595.347558:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338756352:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809595.347564:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:1.0:1780809595.347580:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.347640:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335026816 00000100:00100000:2.0:1780809595.347646:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335026816 00010000:00010000:2.0:1780809595.347669:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 66 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.347697:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 590 00000100:00100000:2.0:1780809595.347707:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2393:x1867312335026816:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809595.347717:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809595.347724:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 66 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.347735:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 66 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.347764:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f41a6 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687243b expref: 66 pid: 77629 timeout: 1957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.347776:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.347781:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.347789:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.347796:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.347819:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809595.347850:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312335026816:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 143us (287us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809595.347851:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.347865:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.347867:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 590 00000004:00200000:1.0:1780809595.347880:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809595.347966:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f41ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 66 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.347976:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 65 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.347981:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.347984:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809595.347986:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64e00, rc 0) 00000100:00100000:1.0:1780809595.348021:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:142955:x1867312335026688:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1390us (1480us total) trans 55834578740 rc 0/0 00000100:00100000:1.0:1780809595.348029:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7578 00000100:00100000:0.0:1780809595.403390:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.403461:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335027072 00000100:00100000:3.0:1780809595.403471:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335027072 00000100:00100000:3.0:1780809595.403518:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7579 00000100:00100000:3.0:1780809595.403525:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:142962:x1867312335027072:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809595.403547:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809595.403564:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f41c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872449 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.403663:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.403677:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.403685:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.403711:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.403717:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.403721:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404043:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f41d7 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404059:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f41d7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404065:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f41d7 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809595.404073:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809595.404152:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404161:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404169:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404176:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809595.404181:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404200:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404213:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809595.404217:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809595.404222:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404229:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f41c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404243:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404250:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404255:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404259:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809595.404261:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404265:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404270:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809595.404271:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809595.404273:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404285:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f41d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404318:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f41c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872449 expref: 68 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404328:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f41d7 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872449 expref: 67 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.404334:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809595.404335:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809595.404337:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809595.404388:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:142962:x1867312335027072:12345-192.168.203.33@tcp:101:dd.0 Request processed in 862us (1004us total) trans 55834578741 rc 0/0 00000100:00100000:3.0:1780809595.404398:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7579 00000100:00100000:3.0:1780809595.405621:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809595.405660:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335027200 00000100:00100000:2.0:1780809595.405666:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335027200 00000100:00100000:2.0:1780809595.405700:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2186 00000100:00100000:2.0:1780809595.405706:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:2392:x1867312335027200:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809595.405715:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809595.405728:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f41d7 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872449 expref: 67 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.405739:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.405742:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809595.405773:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2392:x1867312335027200:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809595.405780:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2186 00010000:00010000:1.0:1780809595.443826:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809595.561805:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809595.561860:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335027456 00000100:00100000:2.0:1780809595.561870:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335027456 00000100:00100000:2.0:1780809595.561944:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7580 00000100:00100000:2.0:1780809595.561956:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:142968:x1867312335027456:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809595.561980:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809595.562009:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f41e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872450 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562078:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562094:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562105:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562120:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562127:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562132:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562426:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f41fa lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562443:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f41fa lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562448:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f41fa lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809595.562457:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809595.562528:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562534:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562539:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562543:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809595.562546:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562550:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562559:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809595.562561:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809595.562564:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562569:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f41ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562624:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562629:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562633:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562636:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809595.562638:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562642:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562647:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:2.0:1780809595.562648:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809595.562650:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562654:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f41f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562692:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f41e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872450 expref: 69 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562703:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f41fa lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872450 expref: 68 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.562717:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.562719:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809595.562721:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809595.562769:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142968:x1867312335027456:12345-192.168.203.33@tcp:101:dd.0 Request processed in 817us (972us total) trans 55834578742 rc 0/0 00000100:00100000:2.0:1780809595.562774:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7580 00000100:00100000:0.0:1780809595.564040:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.564080:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335027584 00000100:00100000:0.0:1780809595.564086:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.564087:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335027584 00000100:00100000:1.0:1780809595.564137:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2187 00000100:00100000:3.0:1780809595.564141:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335027840 00000100:00100000:3.0:1780809595.564147:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335027840 00000100:00100000:1.0:1780809595.564150:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2391:x1867312335027584:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809595.564165:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809595.564186:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f41fa lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872450 expref: 69 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809595.564190:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1857 00000100:00100000:3.0:1780809595.564206:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142968:x1867312335027840:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809595.564214:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.564220:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809595.564255:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2391:x1867312335027584:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809595.564261:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2187 00000100:00100000:3.0:1780809595.564338:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142968:x1867312335027840:12345-192.168.203.33@tcp:35:dd.0 Request processed in 135us (252us total) trans 55834578743 rc 0/0 00000100:00100000:3.0:1780809595.564347:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1857 00000100:00100000:0.0:1780809595.743089:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.743166:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335028096 00000100:00100000:3.0:1780809595.743176:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335028096 00000100:00100000:3.0:1780809595.743230:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1858 00000100:00100000:3.0:1780809595.743255:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:142962:x1867312335028096:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809595.743497:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:142962:x1867312335028096:12345-192.168.203.33@tcp:35:dd.0 Request processed in 245us (416us total) trans 55834578744 rc 0/0 00000100:00100000:3.0:1780809595.743508:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1858 00000100:00100000:0.0:1780809595.763786:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338756480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780809595.763843:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809595.763883:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338756480 00000100:00100000:2.0:1780809595.763902:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338756480 00000100:00100000:2.0:1780809595.763944:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1780809595.763953:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadcf046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338756480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780809595.763981:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809595.764026:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadcf046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338756480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809595.764031:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1780809595.764076:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338756480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780809595.874124:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.874192:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335028224 00000100:00100000:3.0:1780809595.874201:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335028224 00000100:00100000:3.0:1780809595.874247:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7581 00000100:00100000:3.0:1780809595.874253:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:142976:x1867312335028224:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809595.874272:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809595.874291:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872457 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874340:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874352:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874366:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874388:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874397:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874405:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874712:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874728:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 70 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874735:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874761:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 70 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.874771:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 70 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809595.874782:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338756608:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809595.874844:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc73089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809595.875729:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338756608:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809595.875747:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.875924:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809595.875966:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335028480 00000100:00100000:3.0:1780809595.875971:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335028480 00000100:00100000:3.0:1780809595.875995:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1859 00000100:00100000:3.0:1780809595.876001:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:89645:x1867312335028480:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809595.876146:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:89645:x1867312335028480:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 145us (224us total) trans 55834578745 rc 0/0 00000100:00100000:3.0:1780809595.876158:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1859 00000100:00100000:0.0:1780809595.876825:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809595.876897:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335028608 00000100:00100000:2.0:1780809595.876903:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335028608 00010000:00010000:2.0:1780809595.876929:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 72 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.876955:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 591 00000100:00100000:2.0:1780809595.876962:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2394:x1867312335028608:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809595.876971:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809595.876976:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 72 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.876992:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 72 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.877006:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f41b4 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872442 expref: 72 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.877018:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.877021:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.877027:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.877032:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.877048:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809595.877075:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2394:x1867312335028608:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 114us (251us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809595.877077:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.877089:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 591 00010000:00010000:3.0:1780809595.877090:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809595.877114:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809595.877118:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809595.877128:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877137:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877144:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877149:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877154:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877158:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809595.877161:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877166:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877172:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809595.877179:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809595.877183:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877188:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f420f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877196:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877200:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877204:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877207:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809595.877209:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877214:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877219:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91b00) 00010000:00010000:3.0:1780809595.877220:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809595.877222:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877225:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4216 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877245:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877263:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 70 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809595.877269:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809595.877271:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809595.877273:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0031a00, rc 0) 00000100:00100000:3.0:1780809595.877296:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:142976:x1867312335028224:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3043us (3180us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809595.877301:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7581 00000100:00100000:0.0:1780809595.879007:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.879048:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335028864 00000100:00100000:1.0:1780809595.879053:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335028864 00000100:00100000:1.0:1780809595.879082:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7582 00000100:00100000:1.0:1780809595.879088:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:142976:x1867312335028864:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809595.879098:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809595.879107:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687245e expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.879166:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.879175:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.879181:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.879204:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 71 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.879212:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 71 pid: 79214 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809595.879226:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338756736:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809595.879263:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd08e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1780809595.879934:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338756736:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809595.879953:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809595.880116:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809595.880159:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335028992 00000100:00100000:2.0:1780809595.880164:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335028992 00010000:00010000:2.0:1780809595.880178:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 72 pid: 79214 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.880204:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 592 00000100:00100000:2.0:1780809595.880215:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2393:x1867312335028992:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809595.880236:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809595.880243:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 72 pid: 79214 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.880255:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 72 pid: 79214 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.880270:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f421d lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872457 expref: 72 pid: 79214 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.880283:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809595.880288:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.880296:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.880303:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809595.880323:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809595.880354:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.880355:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2393:x1867312335028992:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 142us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809595.880372:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809595.880373:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 592 00000004:00200000:1.0:1780809595.880388:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809595.880473:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 72 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.880489:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 71 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.880497:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.880500:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809595.880503:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65000, rc 0) 00000100:00100000:1.0:1780809595.880549:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142976:x1867312335028864:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1456us (1539us total) trans 55834578746 rc 0/0 00000100:00100000:1.0:1780809595.880557:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7582 00000100:00100000:0.0:1780809595.967965:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.968025:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335029248 00000100:00100000:1.0:1780809595.968053:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335029248 00000100:00100000:1.0:1780809595.968103:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7583 00000100:00100000:1.0:1780809595.968111:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:142983:x1867312335029248:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809595.968141:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809595.968158:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872465 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968218:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968230:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968239:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968249:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968254:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968258:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968547:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f424e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968554:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f424e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968559:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f424e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809595.968574:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809595.968672:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968679:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968683:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968687:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809595.968690:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968696:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968705:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809595.968707:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809595.968710:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968714:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968731:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968736:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968747:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968751:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809595.968753:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968757:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968762:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f400) 00010000:00010000:1.0:1780809595.968764:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809595.968766:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968769:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968801:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872465 expref: 74 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968811:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f424e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872465 expref: 73 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.968823:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.968825:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809595.968827:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65200, rc 0) 00000100:00100000:1.0:1780809595.968874:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142983:x1867312335029248:12345-192.168.203.33@tcp:101:dd.0 Request processed in 763us (915us total) trans 55834578747 rc 0/0 00000100:00100000:1.0:1780809595.968903:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7583 00000100:00100000:0.0:1780809595.970029:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809595.970069:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335029376 00000100:00100000:1.0:1780809595.970073:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335029376 00000100:00100000:1.0:1780809595.970105:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2188 00000100:00100000:1.0:1780809595.970111:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2394:x1867312335029376:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809595.970120:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809595.970131:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f424e lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872465 expref: 73 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809595.970140:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809595.970143:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809595.970167:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2394:x1867312335029376:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 56us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809595.970172:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2188 00000100:00100000:0.0:1780809596.014489:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.014545:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335029504 00000100:00100000:1.0:1780809596.014556:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335029504 00000100:00080000:2.0:1780809596.014625:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780809596.014647:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7584 00000100:00100000:1.0:1780809596.014656:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:142989:x1867312335029504:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809596.014677:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809596.014693:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f425c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687246c expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.014746:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.014758:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.014779:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.014790:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.014794:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.014799:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.015088:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.015097:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 73 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.015103:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.015130:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 73 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.015141:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 73 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.015156:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338756864:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809596.015226:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd511bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1780809596.016054:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338756864:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809596.016071:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809596.016207:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.016252:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335029760 00000100:00100000:3.0:1780809596.016257:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335029760 00000100:00100000:3.0:1780809596.016293:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1860 00000100:00100000:3.0:1780809596.016301:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:89645:x1867312335029760:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809596.016453:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:89645:x1867312335029760:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 152us (245us total) trans 55834578748 rc 0/0 00000100:00100000:3.0:1780809596.016462:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1860 00000100:00100000:0.0:1780809596.017160:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.017202:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335029888 00000100:00100000:2.0:1780809596.017207:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335029888 00010000:00010000:2.0:1780809596.017225:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 75 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.017257:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 593 00000100:00100000:2.0:1780809596.017263:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:2393:x1867312335029888:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809596.017272:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809596.017277:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 75 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.017287:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 75 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.017300:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f422b lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687245e expref: 75 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.017310:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.017314:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.017320:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.017324:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.017341:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809596.017373:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2393:x1867312335029888:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 104us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809596.017383:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 593 00010000:00010000:1.0:1780809596.017385:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017397:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809596.017427:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809596.017433:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809596.017449:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017458:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017466:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017474:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017482:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017488:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.017493:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017502:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017521:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809596.017525:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.017529:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017535:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017543:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017548:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017552:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017555:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.017557:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017561:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017566:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f400) 00010000:00010000:1.0:1780809596.017567:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.017569:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017573:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f426a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017635:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f425c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 74 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017649:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 73 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.017655:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.017657:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809596.017659:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65400, rc 0) 00000100:00100000:1.0:1780809596.017685:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142989:x1867312335029504:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3032us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809596.017690:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7584 00000100:00100000:0.0:1780809596.019355:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.019402:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335030144 00000100:00100000:3.0:1780809596.019408:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335030144 00000100:00100000:3.0:1780809596.019443:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7585 00000100:00100000:3.0:1780809596.019451:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:142989:x1867312335030144:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809596.019466:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809596.019479:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872473 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809596.019531:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809596.019546:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 74 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809596.019552:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809596.019570:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 74 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809596.019579:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 74 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809596.019618:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338756992:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809596.019668:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc73089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809596.020324:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338756992:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809596.020342:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809596.020507:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.020543:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335030272 00000100:00100000:2.0:1780809596.020552:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335030272 00010000:00010000:2.0:1780809596.020568:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 75 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.020608:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 594 00000100:00100000:2.0:1780809596.020616:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:2394:x1867312335030272:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809596.020623:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809596.020628:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 75 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.020637:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 75 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.020647:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f4271 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687246c expref: 75 pid: 80225 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.020655:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.020659:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.020664:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.020669:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.020683:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809596.020705:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2394:x1867312335030272:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 91us (199us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809596.020714:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.020723:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 594 00010000:00010000:3.0:1780809596.020725:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809596.020735:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809596.020809:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 75 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809596.020831:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 74 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809596.020837:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809596.020839:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809596.020841:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809596.020867:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:142989:x1867312335030144:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1418us (1514us total) trans 55834578749 rc 0/0 00000100:00100000:3.0:1780809596.020898:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7585 00000100:00100000:0.0:1780809596.024235:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.024281:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335030528 00000100:00100000:2.0:1780809596.024289:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335030528 00000100:00100000:2.0:1780809596.024328:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7586 00000100:00100000:2.0:1780809596.024338:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:142995:x1867312335030528:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809596.024354:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809596.024368:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f428d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687247a expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024422:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024434:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024443:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024457:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024465:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024472:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024806:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f42a2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024828:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f42a2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024836:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f42a2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809596.024845:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809596.024930:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024939:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024946:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024952:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809596.024955:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024963:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024972:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809596.024974:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809596.024978:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.024984:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025018:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025025:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025032:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025038:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809596.025041:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025048:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025055:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:2.0:1780809596.025057:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809596.025061:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025066:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f429b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025108:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f428d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687247a expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025124:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f42a2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687247a expref: 76 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.025143:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.025146:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809596.025148:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:2.0:1780809596.025188:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142995:x1867312335030528:12345-192.168.203.33@tcp:101:dd.0 Request processed in 852us (955us total) trans 55834578750 rc 0/0 00000100:00100000:2.0:1780809596.025195:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7586 00000100:00100000:0.0:1780809596.026261:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.026298:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335030784 00000100:00100000:3.0:1780809596.026303:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335030784 00000100:00100000:3.0:1780809596.026331:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1861 00000100:00100000:3.0:1780809596.026336:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:142995:x1867312335030784:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809596.026448:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:142995:x1867312335030784:12345-192.168.203.33@tcp:35:dd.0 Request processed in 111us (188us total) trans 55834578751 rc 0/0 00000100:00100000:3.0:1780809596.026454:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1861 00000100:00100000:0.0:1780809596.027722:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.027770:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335030912 00000100:00100000:1.0:1780809596.027776:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335030912 00000100:00100000:1.0:1780809596.027812:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2189 00000100:00100000:1.0:1780809596.027820:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2393:x1867312335030912:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809596.027831:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809596.027847:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f42a2 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687247a expref: 77 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.027867:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.027892:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809596.027929:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:2393:x1867312335030912:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809596.027937:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2189 00000100:00100000:0.0:1780809596.179933:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.179997:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335031168 00000100:00100000:3.0:1780809596.180008:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335031168 00000100:00100000:1.0:1780809596.180081:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7587 00000100:00100000:1.0:1780809596.180093:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccdfeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:143010:x1867312335031168:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809596.180117:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809596.180137:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f42b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872481 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180209:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180225:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180237:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180254:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180262:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180269:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180640:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f42c5 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180648:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f42c5 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180654:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f42c5 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809596.180671:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809596.180741:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180747:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180752:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180755:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.180759:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180764:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180773:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809596.180775:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.180779:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180783:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180791:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180795:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180807:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180811:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.180813:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180816:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180821:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f400) 00010000:00010000:1.0:1780809596.180823:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.180824:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180828:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180859:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f42b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872481 expref: 79 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180868:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f42c5 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872481 expref: 78 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.180874:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.180875:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809596.180877:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65400, rc 0) 00000100:00100000:1.0:1780809596.180948:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccdfeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:143010:x1867312335031168:12345-192.168.203.33@tcp:101:dd.0 Request processed in 857us (1021us total) trans 55834578752 rc 0/0 00000100:00100000:1.0:1780809596.180967:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7587 00000100:00100000:0.0:1780809596.182179:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809596.182202:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.182234:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335031296 00000100:00100000:2.0:1780809596.182241:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335031296 00000100:00100000:3.0:1780809596.182250:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335031552 00000100:00100000:3.0:1780809596.182256:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335031552 00000100:00100000:2.0:1780809596.182285:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2190 00000100:00100000:2.0:1780809596.182300:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccdfe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:2392:x1867312335031296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809596.182301:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1862 00010000:00010000:2.0:1780809596.182317:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809596.182324:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccdc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:143010:x1867312335031552:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809596.182334:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f42c5 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872481 expref: 79 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.182350:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.182355:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809596.182400:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccdfe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2392:x1867312335031296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 105us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809596.182409:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2190 00000100:00100000:3.0:1780809596.182461:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccdc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:143010:x1867312335031552:12345-192.168.203.33@tcp:35:dd.0 Request processed in 142us (256us total) trans 55834578753 rc 0/0 00000100:00100000:3.0:1780809596.182468:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1862 00000100:00100000:0.0:1780809596.329688:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.329761:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335031808 00000100:00100000:3.0:1780809596.329771:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335031808 00000100:00100000:3.0:1780809596.329826:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1863 00000100:00100000:3.0:1780809596.329834:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:142983:x1867312335031808:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809596.330042:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:142983:x1867312335031808:12345-192.168.203.33@tcp:35:dd.0 Request processed in 209us (362us total) trans 55834578754 rc 0/0 00000100:00100000:3.0:1780809596.330048:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1863 00000100:00100000:0.0:1780809596.352495:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.352556:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335031936 00000100:00100000:1.0:1780809596.352568:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335031936 00000100:00100000:1.0:1780809596.352643:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7588 00000100:00100000:1.0:1780809596.352655:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:143018:x1867312335031936:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809596.352678:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809596.352698:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f42d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872488 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.352760:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.352775:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.352787:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.352807:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.352815:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.352824:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.353111:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.353128:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 80 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.353135:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.353160:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 80 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.353170:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 80 pid: 78216 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.353181:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338757120:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809596.353245:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd08e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1780809596.354068:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338757120:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809596.354086:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809596.354245:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.354286:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335032192 00000100:00100000:3.0:1780809596.354291:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335032192 00000100:00100000:3.0:1780809596.354319:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1864 00000100:00100000:3.0:1780809596.354327:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:90168:x1867312335032192:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809596.354496:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:90168:x1867312335032192:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 171us (251us total) trans 55834578755 rc 0/0 00000100:00100000:3.0:1780809596.354502:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1864 00000100:00100000:0.0:1780809596.355167:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.355220:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335032320 00000100:00100000:2.0:1780809596.355225:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335032320 00010000:00010000:2.0:1780809596.355246:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 82 pid: 78216 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.355270:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 595 00000100:00100000:2.0:1780809596.355283:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2394:x1867312335032320:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809596.355293:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809596.355298:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 82 pid: 78216 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.355308:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 82 pid: 78216 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.355321:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f427f lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872473 expref: 82 pid: 78216 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.355339:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.355343:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.355350:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.355357:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.355383:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809596.355417:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:2394:x1867312335032320:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 133us (250us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809596.355417:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.355434:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 595 00010000:00010000:1.0:1780809596.355434:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809596.355461:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809596.355465:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809596.355476:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355494:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355502:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355507:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355512:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355516:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.355519:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355524:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355531:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809596.355532:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.355536:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355539:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f42da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355547:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355551:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355560:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355566:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.355570:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355577:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355623:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f400) 00010000:00010000:1.0:1780809596.355627:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.355632:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355639:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f42e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355675:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f42d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 81 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355689:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 80 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.355698:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.355701:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809596.355704:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65000, rc 0) 00000100:00100000:1.0:1780809596.355740:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:143018:x1867312335031936:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3087us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809596.355761:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7588 00000100:00100000:0.0:1780809596.357397:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.357440:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335032576 00000100:00100000:1.0:1780809596.357445:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335032576 00000100:00100000:1.0:1780809596.357472:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7589 00000100:00100000:1.0:1780809596.357477:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:143018:x1867312335032576:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809596.357487:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809596.357496:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f42ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687248f expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.357542:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.357550:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 81 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.357556:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.357570:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 81 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.357578:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 81 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.357605:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338757248:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809596.357642:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd08e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1780809596.358316:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338757248:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809596.358339:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809596.358654:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.358688:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335032704 00000100:00100000:1.0:1780809596.358693:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335032704 00010000:00010000:1.0:1780809596.358712:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 82 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.358737:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 596 00000100:00100000:1.0:1780809596.358747:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfce92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2393:x1867312335032704:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809596.358757:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809596.358763:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 82 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.358775:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 82 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.358791:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f42e8 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872488 expref: 82 pid: 77628 timeout: 1958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.358802:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.358808:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.358817:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.358824:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.358861:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809596.358898:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.358908:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:2393:x1867312335032704:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 161us (252us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809596.358912:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.358921:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 596 00000004:00200000:2.0:1780809596.358939:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809596.359032:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f42ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 82 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.359049:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 81 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.359058:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.359061:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809596.359063:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65c00, rc 0) 00000100:00100000:2.0:1780809596.359103:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfce91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:143018:x1867312335032576:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1619us (1703us total) trans 55834578756 rc 0/0 00000100:00100000:2.0:1780809596.359112:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7589 00000100:00100000:0.0:1780809596.413929:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.413990:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335032832 00000100:00100000:3.0:1780809596.414001:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335032832 00000100:00100000:0.0:1780809596.414007:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809596.414054:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.414065:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 389 00000100:00100000:1.0:1780809596.414073:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335032960 00000100:00100000:3.0:1780809596.414076:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf4fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312335032832:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809596.414079:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335032960 00000100:00100000:0.0:1780809596.414092:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335033088 00000100:00100000:0.0:1780809596.414100:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335033088 00000100:00080000:1.0:1780809596.414108:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780809596.414113:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780809596.414149:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 664 00000100:00100000:1.0:1780809596.414153:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1102 00000100:00100000:3.0:1780809596.414160:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf4fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312335032832:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809596.414167:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335033088:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809596.414169:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312335032960:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809596.414178:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 389 00000100:00100000:1.0:1780809596.414210:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312335032960:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 46us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809596.414218:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.414224:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1102 00000100:00100000:0.0:1780809596.414230:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335033088:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809596.414241:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 664 00000100:00100000:3.0:1780809596.414249:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335033216 00000100:00100000:3.0:1780809596.414254:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335033216 00000100:00080000:1.0:1780809596.414279:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809596.414303:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1103 00000100:00100000:3.0:1780809596.414316:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335033216:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809596.414324:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.414372:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335033216:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809596.414379:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1103 00000100:00100000:1.0:1780809596.414385:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335033344 00000100:00100000:1.0:1780809596.414392:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335033344 00000100:00100000:1.0:1780809596.414437:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1104 00000100:00100000:1.0:1780809596.414446:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335033344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809596.414482:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335033344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809596.414489:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1104 00000100:00080000:1.0:1780809596.414516:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1780809596.467728:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809596.633563:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.633620:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335033600 00000100:00100000:1.0:1780809596.633631:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335033600 00000100:00100000:1.0:1780809596.633682:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7590 00000100:00100000:1.0:1780809596.633703:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:143025:x1867312335033600:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809596.633727:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809596.633743:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872496 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.633803:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.633815:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.633824:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.633835:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.633839:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.633844:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634172:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4319 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634180:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4319 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634185:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4319 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809596.634201:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809596.634272:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634278:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634283:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634287:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.634290:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634296:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634305:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809596.634307:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.634310:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634315:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f430b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634323:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634327:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634339:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634343:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.634345:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634348:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634353:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f400) 00010000:00010000:1.0:1780809596.634355:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.634357:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634360:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4312 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634392:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872496 expref: 84 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634401:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4319 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872496 expref: 83 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.634406:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.634408:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809596.634411:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65800, rc 0) 00000100:00100000:1.0:1780809596.634470:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:143025:x1867312335033600:12345-192.168.203.33@tcp:101:dd.0 Request processed in 767us (912us total) trans 55834578757 rc 0/0 00000100:00100000:1.0:1780809596.634485:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7590 00000100:00100000:2.0:1780809596.635986:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.636021:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335033728 00000100:00100000:1.0:1780809596.636026:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335033728 00000100:00100000:1.0:1780809596.636056:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2191 00000100:00100000:1.0:1780809596.636061:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2394:x1867312335033728:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809596.636070:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809596.636082:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4319 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872496 expref: 83 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.636092:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.636096:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809596.636121:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2394:x1867312335033728:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809596.636126:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2191 00000040:00080000:1.0:1780809596.660156:0:77663:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1780809596.662757:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.662807:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335033984 00000100:00100000:1.0:1780809596.662815:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335033984 00000100:00100000:1.0:1780809596.662862:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7591 00000100:00100000:1.0:1780809596.662870:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:143031:x1867312335033984:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809596.662901:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809596.662919:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687249d expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.662978:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.662990:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663012:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663023:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663028:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663032:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663313:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f433c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663320:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f433c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663326:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f433c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809596.663333:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809596.663405:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663410:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663415:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663419:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.663430:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663438:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663451:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809596.663455:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.663460:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663467:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f432e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663480:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663485:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663489:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663492:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809596.663494:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663498:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663502:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f400) 00010000:00010000:1.0:1780809596.663504:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809596.663511:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663515:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4335 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663548:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687249d expref: 85 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663557:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f433c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687249d expref: 84 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.663562:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.663564:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809596.663566:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65200, rc 0) 00000100:00100000:1.0:1780809596.663638:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:143031:x1867312335033984:12345-192.168.203.33@tcp:101:dd.0 Request processed in 769us (886us total) trans 55834578758 rc 0/0 00000100:00100000:1.0:1780809596.663644:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7591 00000100:00100000:0.0:1780809596.664824:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.664866:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335034112 00000100:00100000:0.0:1780809596.664871:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.664873:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335034112 00000100:00100000:2.0:1780809596.664926:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2192 00000100:00100000:3.0:1780809596.664933:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335034368 00000100:00100000:2.0:1780809596.664934:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312335034112:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809596.664942:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335034368 00010000:00010000:2.0:1780809596.664945:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809596.664962:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f433c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687249d expref: 85 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.664984:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.664989:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809596.664990:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1865 00000100:00100000:3.0:1780809596.665003:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:143031:x1867312335034368:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809596.665036:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2393:x1867312335034112:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 101us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809596.665047:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2192 00000100:00100000:3.0:1780809596.665171:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:143031:x1867312335034368:12345-192.168.203.33@tcp:35:dd.0 Request processed in 170us (300us total) trans 55834578759 rc 0/0 00000100:00100000:3.0:1780809596.665180:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1865 00000100:00100000:0.0:1780809596.791210:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809596.791244:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335034496 00000100:00100000:1.0:1780809596.791254:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335034496 00000100:00100000:1.0:1780809596.791300:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7592 00000100:00100000:1.0:1780809596.791310:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:143038:x1867312335034496:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809596.791332:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809596.791351:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f434a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724a4 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791425:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791449:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791461:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791476:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791481:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791487:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791921:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791931:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 85 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791938:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791969:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 85 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.791981:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 85 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.792004:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338757376:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809596.792083:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd511b900 going to sleep for 11 seconds 00000100:00100000:0.0:1780809596.792940:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338757376:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809596.792961:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.792972:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809596.792994:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335034752 00000100:00100000:0.0:1780809596.793000:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335034752 00000100:00100000:0.0:1780809596.793089:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1866 00000100:00100000:0.0:1780809596.793099:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:89645:x1867312335034752:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809596.793321:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+87:89645:x1867312335034752:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 224us (350us total) trans 55834578760 rc 0/0 00000100:00100000:0.0:1780809596.793329:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1866 00000100:00100000:1.0:1780809596.794224:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.794272:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335034880 00000100:00100000:2.0:1780809596.794278:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335034880 00010000:00010000:2.0:1780809596.794302:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 87 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.794351:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 597 00000100:00100000:2.0:1780809596.794363:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+87:2394:x1867312335034880:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809596.794375:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809596.794382:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 87 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.794398:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 87 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.794419:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f42f6 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687248f expref: 87 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.794437:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.794441:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.794448:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.794453:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.794479:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809596.794488:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794497:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.794508:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+86:2394:x1867312335034880:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 149us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809596.794515:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 597 00000004:00200000:0.0:1780809596.794523:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809596.794528:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809596.794549:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794559:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794567:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794573:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794578:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794583:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809596.794615:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794621:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794629:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809596.794731:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809596.794735:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794741:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794753:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794758:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794768:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794772:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809596.794775:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794780:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794788:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f400) 00010000:00010000:0.0:1780809596.794790:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809596.794793:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794798:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4358 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794836:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f434a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 86 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794853:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 85 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809596.794863:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809596.794866:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809596.794870:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:0.0:1780809596.794930:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+85:143038:x1867312335034496:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3621us (3725us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809596.794944:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7592 00000001:00080000:2.0:1780809596.795749:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578733 is committed 00000001:00080000:2.0:1780809596.795776:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578758 is committed 00000001:00080000:2.0:1780809596.795814:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578759 is committed 00000100:00100000:1.0:1780809596.796400:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.796439:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335035136 00000100:00100000:2.0:1780809596.796444:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335035136 00000100:00100000:2.0:1780809596.796472:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7593 00000100:00100000:2.0:1780809596.796479:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:143038:x1867312335035136:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809596.796490:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809596.796498:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724ab expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.796544:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.796552:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 19 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.796557:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.796573:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 19 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.796582:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 19 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.796620:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338757504:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809596.796659:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc9647a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780809596.797280:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338757504:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809596.797293:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809596.797496:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809596.797527:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335035264 00000100:00100000:2.0:1780809596.797532:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335035264 00010000:00010000:2.0:1780809596.797548:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 20 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809596.797570:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 598 00000100:00100000:2.0:1780809596.797577:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2393:x1867312335035264:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809596.797583:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809596.797604:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 20 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.797615:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 20 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.797626:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f435f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724a4 expref: 20 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.797636:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809596.797640:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.797645:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.797658:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809596.797673:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809596.797696:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2393:x1867312335035264:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 120us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809596.797703:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 598 00010000:00010000:1.0:1780809596.797714:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.797725:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809596.797736:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809596.797801:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 20 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.797823:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 19 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809596.797828:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809596.797830:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809596.797832:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ea00, rc 0) 00000100:00100000:1.0:1780809596.797859:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:143038:x1867312335035136:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1382us (1460us total) trans 55834578761 rc 0/0 00000100:00100000:1.0:1780809596.797873:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7593 00000100:00100000:1.0:1780809596.961741:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809596.961809:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335035520 00000100:00100000:3.0:1780809596.961818:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335035520 00000100:00100000:3.0:1780809596.961863:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1867 00000100:00100000:3.0:1780809596.961870:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:143025:x1867312335035520:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809596.962080:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:143025:x1867312335035520:12345-192.168.203.33@tcp:35:dd.0 Request processed in 210us (348us total) trans 55834578762 rc 0/0 00000100:00100000:3.0:1780809596.962086:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1867 00000100:00100000:2.0:1780809597.014007:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809597.014072:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335035776 00000100:00100000:3.0:1780809597.014083:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335035776 00000100:00100000:3.0:1780809597.014151:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7594 00000100:00100000:3.0:1780809597.014162:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:143046:x1867312335035776:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809597.014186:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809597.014206:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f437b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724b2 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014296:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014313:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014326:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014342:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014350:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014358:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014704:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4390 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014712:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4390 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014718:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4390 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809597.014725:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809597.014793:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014806:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014811:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014815:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809597.014818:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014824:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014833:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809597.014835:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809597.014838:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014842:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014851:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014855:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014859:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014862:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809597.014868:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014872:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014895:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91900) 00010000:00010000:3.0:1780809597.014897:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809597.014899:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014904:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4389 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014934:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f437b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b2 expref: 23 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014944:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4390 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b2 expref: 22 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.014949:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809597.014950:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809597.014952:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809597.014997:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:143046:x1867312335035776:12345-192.168.203.33@tcp:101:dd.0 Request processed in 838us (999us total) trans 55834578763 rc 0/0 00000100:00100000:3.0:1780809597.015002:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7594 00000100:00100000:0.0:1780809597.016027:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.016084:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335035904 00000100:00100000:2.0:1780809597.016089:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335035904 00000100:00100000:2.0:1780809597.016122:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2193 00000100:00100000:2.0:1780809597.016128:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:2392:x1867312335035904:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809597.016136:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809597.016147:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4390 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b2 expref: 22 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.016157:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.016160:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809597.016193:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:2392:x1867312335035904:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809597.016198:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2193 00000100:00100000:1.0:1780809597.029568:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.029622:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335036032 00000100:00100000:2.0:1780809597.029633:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335036032 00000100:00100000:2.0:1780809597.029676:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7595 00000100:00100000:2.0:1780809597.029685:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:143052:x1867312335036032:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809597.029703:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809597.029727:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f439e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724b9 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.029774:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.029785:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.029793:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.029803:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.029816:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.029821:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.030118:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.030130:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 22 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.030139:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.030172:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 22 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.030195:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 22 pid: 80225 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.030210:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338757632:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809597.030279:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc96470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780809597.031082:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338757632:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809597.031097:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809597.031316:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.031388:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335036288 00000100:00100000:0.0:1780809597.031394:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335036288 00000100:00100000:0.0:1780809597.031429:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1868 00000100:00100000:0.0:1780809597.031439:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:89645:x1867312335036288:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809597.031615:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:89645:x1867312335036288:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 154us (276us total) trans 55834578764 rc 0/0 00000100:00100000:0.0:1780809597.031623:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1868 00000100:00100000:1.0:1780809597.032354:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.032392:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335036416 00000100:00100000:2.0:1780809597.032397:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335036416 00010000:00010000:2.0:1780809597.032412:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 24 pid: 80225 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.032435:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 599 00000100:00100000:2.0:1780809597.032441:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2394:x1867312335036416:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809597.032448:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809597.032453:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 24 pid: 80225 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.032463:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 24 pid: 80225 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.032475:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f436d lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ab expref: 24 pid: 80225 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.032503:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.032507:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.032513:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.032517:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.032532:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809597.032559:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2394:x1867312335036416:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 118us (205us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809597.032559:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.032575:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 599 00010000:00010000:1.0:1780809597.032575:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809597.032622:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809597.032626:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809597.032638:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032647:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032654:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032659:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032664:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032668:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809597.032672:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032684:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032692:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809597.032694:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809597.032698:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032702:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f43a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032714:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032718:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032722:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032725:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809597.032727:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032731:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032736:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54a00) 00010000:00010000:1.0:1780809597.032738:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809597.032740:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032752:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f43ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032778:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f439e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032796:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 22 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.032802:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809597.032803:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809597.032805:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:1.0:1780809597.032832:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:143052:x1867312335036032:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3149us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809597.032837:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7595 00000100:00100000:1.0:1780809597.034155:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809597.034209:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335036672 00000100:00100000:3.0:1780809597.034215:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335036672 00000100:00100000:3.0:1780809597.034244:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7596 00000100:00100000:3.0:1780809597.034251:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:143052:x1867312335036672:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809597.034266:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809597.034275:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f43ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724c0 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.034321:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.034330:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.034335:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.034351:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 23 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.034363:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 23 pid: 77627 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809597.034375:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338757760:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809597.034426:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc31509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809597.035113:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338757760:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809597.035131:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809597.035275:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.035309:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335036800 00000100:00100000:2.0:1780809597.035314:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335036800 00010000:00010000:2.0:1780809597.035330:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 24 pid: 77627 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.035352:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 600 00000100:00100000:2.0:1780809597.035358:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2393:x1867312335036800:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809597.035365:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809597.035369:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 24 pid: 77627 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.035379:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 24 pid: 77627 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.035398:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43b3 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724b9 expref: 24 pid: 77627 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.035409:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.035412:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.035418:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.035422:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.035435:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809597.035459:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2393:x1867312335036800:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 99us (183us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809597.035463:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.035470:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 600 00010000:00010000:3.0:1780809597.035479:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809597.035499:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809597.035578:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f43ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 24 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.035624:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 23 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.035633:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809597.035636:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809597.035639:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809597.035675:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:143052:x1867312335036672:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1423us (1519us total) trans 55834578765 rc 0/0 00000100:00100000:3.0:1780809597.035683:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7596 00000100:00100000:1.0:1780809597.293001:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.293065:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335037056 00000100:00100000:2.0:1780809597.293075:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335037056 00000100:00100000:2.0:1780809597.293148:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7597 00000100:00100000:2.0:1780809597.293159:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:143066:x1867312335037056:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809597.293184:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809597.293204:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724c7 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293274:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293306:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293319:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293335:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293342:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293359:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293787:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f43e4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293808:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f43e4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293817:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f43e4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809597.293828:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809597.293943:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293952:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293960:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293975:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809597.293979:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.293987:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294000:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809597.294003:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809597.294008:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294015:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f43d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294040:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294047:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294053:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294058:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809597.294060:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294066:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294083:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:2.0:1780809597.294086:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809597.294090:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294096:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f43dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294148:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f43cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c7 expref: 26 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294164:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f43e4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c7 expref: 25 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.294183:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.294186:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809597.294188:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:2.0:1780809597.294243:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:143066:x1867312335037056:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1085us (1249us total) trans 55834578766 rc 0/0 00000100:00100000:2.0:1780809597.294252:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7597 00000100:00100000:2.0:1780809597.295442:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.295480:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335037184 00000100:00100000:0.0:1780809597.295485:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335037184 00000100:00100000:2.0:1780809597.295501:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.295527:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2194 00000100:00100000:3.0:1780809597.295557:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335037440 00000100:00100000:3.0:1780809597.295562:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335037440 00000100:00100000:0.0:1780809597.295569:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2391:x1867312335037184:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809597.295582:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809597.295621:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1869 00010000:00010000:0.0:1780809597.295622:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f43e4 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c7 expref: 26 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809597.295633:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:143066:x1867312335037440:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:0.0:1780809597.295641:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809597.295645:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809597.295673:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:2391:x1867312335037184:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809597.295680:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2194 00000100:00100000:3.0:1780809597.295748:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:143066:x1867312335037440:12345-192.168.203.33@tcp:35:dd.0 Request processed in 116us (247us total) trans 55834578767 rc 0/0 00000100:00100000:3.0:1780809597.295755:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1869 00000100:00100000:2.0:1780809597.353984:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.354045:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335037696 00000100:00100000:0.0:1780809597.354055:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335037696 00000100:00100000:0.0:1780809597.354101:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1870 00000100:00100000:0.0:1780809597.354109:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:143046:x1867312335037696:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809597.354317:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:143046:x1867312335037696:12345-192.168.203.33@tcp:35:dd.0 Request processed in 207us (341us total) trans 55834578768 rc 0/0 00000100:00100000:0.0:1780809597.354324:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1870 00010000:00010000:1.0:1780809597.491775:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809597.664251:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.664301:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335037824 00000100:00100000:0.0:1780809597.664311:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335037824 00000100:00100000:0.0:1780809597.664359:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7598 00000100:00100000:0.0:1780809597.664368:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:143074:x1867312335037824:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809597.664388:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809597.664404:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f43f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724ce expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664454:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664466:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664474:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664483:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664488:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664492:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664790:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664804:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 27 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664810:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664835:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 27 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.664846:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 27 pid: 79214 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809597.664856:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef8c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338757888:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809597.664936:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd0c23000 going to sleep for 11 seconds 00000100:00100000:0.0:1780809597.665829:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef8c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338757888:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809597.665848:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809597.665895:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809597.665968:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335038080 00000100:00100000:3.0:1780809597.665975:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335038080 00000100:00100000:3.0:1780809597.666017:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1871 00000100:00100000:3.0:1780809597.666028:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:89645:x1867312335038080:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809597.666226:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:89645:x1867312335038080:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 199us (329us total) trans 55834578769 rc 0/0 00000100:00100000:3.0:1780809597.666245:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1871 00000100:00100000:1.0:1780809597.667084:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.667126:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335038208 00000100:00100000:2.0:1780809597.667132:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335038208 00010000:00010000:2.0:1780809597.667156:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 29 pid: 79214 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.667199:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 601 00000100:00100000:2.0:1780809597.667205:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2392:x1867312335038208:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809597.667214:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809597.667220:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 29 pid: 79214 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.667232:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 29 pid: 79214 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.667246:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f43c1 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724c0 expref: 29 pid: 79214 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.667257:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.667261:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.667267:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.667271:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.667286:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809597.667309:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2392:x1867312335038208:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 105us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809597.667315:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.667316:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 601 00010000:00010000:0.0:1780809597.667325:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809597.667349:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809597.667352:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809597.667364:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667381:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667389:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667394:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667399:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667404:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809597.667407:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667413:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667419:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809597.667421:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809597.667424:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667429:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f43f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667476:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667481:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667490:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667494:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809597.667496:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667500:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667506:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809597.667508:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809597.667510:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667514:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667539:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f43f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 28 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667547:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 27 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.667552:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809597.667553:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809597.667555:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce200, rc 0) 00000100:00100000:0.0:1780809597.667582:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:143074:x1867312335037824:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3215us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809597.667629:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7598 00000100:00100000:1.0:1780809597.669068:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.669111:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335038464 00000100:00100000:2.0:1780809597.669125:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335038464 00000100:00100000:2.0:1780809597.669163:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7599 00000100:00100000:2.0:1780809597.669169:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:143074:x1867312335038464:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809597.669186:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809597.669197:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f440e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724d5 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.669252:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.669262:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 28 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.669268:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.669285:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 28 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.669294:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 28 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.669303:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338758016:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809597.669343:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc9647a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780809597.670103:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338758016:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809597.670116:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809597.670252:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.670287:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335038592 00000100:00100000:2.0:1780809597.670292:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335038592 00010000:00010000:2.0:1780809597.670308:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 29 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.670341:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 602 00000100:00100000:2.0:1780809597.670346:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2394:x1867312335038592:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809597.670363:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809597.670368:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 29 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.670377:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 29 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.670387:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4407 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ce expref: 29 pid: 77629 timeout: 1959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.670400:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.670403:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.670408:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.670413:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.670426:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809597.670445:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.670453:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809597.670455:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2394:x1867312335038592:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 108us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809597.670469:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 602 00000004:00200000:1.0:1780809597.670477:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809597.670583:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f440e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 29 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.670635:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 28 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809597.670644:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809597.670647:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809597.670649:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e400, rc 0) 00000100:00100000:1.0:1780809597.670677:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:143074:x1867312335038464:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1509us (1612us total) trans 55834578770 rc 0/0 00000100:00100000:1.0:1780809597.670682:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7599 00000100:00100000:1.0:1780809597.683325:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809597.683387:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335038848 00000100:00100000:3.0:1780809597.683398:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335038848 00000100:00100000:3.0:1780809597.683455:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7600 00000100:00100000:3.0:1780809597.683465:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:143080:x1867312335038848:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809597.683484:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809597.683501:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4423 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724dc expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683557:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683569:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683578:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683612:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683618:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683624:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683938:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4438 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683956:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4438 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.683961:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4438 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809597.683970:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809597.684037:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684043:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684050:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684056:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809597.684061:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684070:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684083:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809597.684087:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809597.684092:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684100:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f442a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684124:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684132:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684138:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684144:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809597.684147:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684154:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684163:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91900) 00010000:00010000:3.0:1780809597.684166:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809597.684170:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684177:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4431 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684214:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4423 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724dc expref: 31 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684225:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4438 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724dc expref: 30 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809597.684240:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809597.684242:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809597.684244:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809597.684291:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:143080:x1867312335038848:12345-192.168.203.33@tcp:101:dd.0 Request processed in 829us (974us total) trans 55834578771 rc 0/0 00000100:00100000:3.0:1780809597.684297:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7600 00000100:00100000:2.0:1780809597.685382:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.685438:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335038976 00000100:00100000:0.0:1780809597.685444:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335038976 00000100:00100000:0.0:1780809597.685486:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2195 00000100:00100000:0.0:1780809597.685495:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2391:x1867312335038976:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809597.685506:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809597.685518:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4438 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724dc expref: 30 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809597.685529:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809597.685531:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809597.685557:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2391:x1867312335038976:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809597.685562:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2195 00000100:00100000:1.0:1780809597.750161:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809597.750217:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335039232 00000100:00100000:2.0:1780809597.750226:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335039232 00000100:00100000:2.0:1780809597.750279:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7601 00000100:00100000:2.0:1780809597.750288:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:143087:x1867312335039232:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809597.750308:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809597.750326:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724e3 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750394:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750407:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750416:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750426:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750431:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750436:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750782:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f445b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750790:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f445b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750804:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f445b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809597.750812:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809597.750913:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750920:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750924:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750929:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809597.750932:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750937:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750947:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809597.750949:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809597.750952:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750956:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f444d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750977:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750990:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750994:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.750998:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809597.751000:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.751003:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.751008:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:2.0:1780809597.751010:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809597.751012:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.751015:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.751051:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724e3 expref: 32 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.751067:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f445b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724e3 expref: 31 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.751073:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.751075:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809597.751083:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809597.751153:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:143087:x1867312335039232:12345-192.168.203.33@tcp:101:dd.0 Request processed in 864us (1000us total) trans 55834578772 rc 0/0 00000100:00100000:2.0:1780809597.751161:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7601 00000100:00100000:1.0:1780809597.752345:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.752382:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335039616 00000100:00100000:1.0:1780809597.752388:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809597.752388:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335039616 00000100:00100000:0.0:1780809597.752428:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1872 00000100:00100000:2.0:1780809597.752432:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335039360 00000100:00100000:0.0:1780809597.752438:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:143087:x1867312335039616:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809597.752441:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335039360 00000100:00100000:2.0:1780809597.752491:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2196 00000100:00100000:2.0:1780809597.752501:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:2392:x1867312335039360:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809597.752511:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809597.752524:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f445b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724e3 expref: 33 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809597.752546:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809597.752549:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809597.752557:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:143087:x1867312335039616:12345-192.168.203.33@tcp:35:dd.0 Request processed in 120us (210us total) trans 55834578773 rc 0/0 00000100:00100000:0.0:1780809597.752565:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1872 00000100:00100000:2.0:1780809597.752576:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2392:x1867312335039360:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809597.752584:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2196 00000100:00100000:0.0:1780809598.005785:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.005843:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335039744 00000100:00100000:3.0:1780809598.005853:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335039744 00000100:00080000:1.0:1780809598.005922:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809598.005936:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7602 00000100:00100000:3.0:1780809598.005949:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:143094:x1867312335039744:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809598.005974:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809598.005991:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724ea expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006044:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006056:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006065:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006074:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006078:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006097:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006387:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006396:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 32 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006402:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006428:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 32 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.006439:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 32 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809598.006449:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338758144:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809598.006519:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc3150540 going to sleep for 11 seconds 00000100:00100000:3.0:1780809598.007411:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338758144:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809598.007430:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809598.007530:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.007562:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335040000 00000100:00100000:3.0:1780809598.007566:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335040000 00000100:00100000:3.0:1780809598.007625:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1873 00000100:00100000:3.0:1780809598.007634:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:89646:x1867312335040000:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809598.007784:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:89646:x1867312335040000:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 151us (254us total) trans 55834578774 rc 0/0 00000100:00100000:3.0:1780809598.007790:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1873 00000100:00100000:1.0:1780809598.008488:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.008547:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335040128 00000100:00100000:2.0:1780809598.008560:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335040128 00010000:00010000:2.0:1780809598.008609:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 34 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.008647:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 603 00000100:00100000:2.0:1780809598.008657:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2394:x1867312335040128:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.008668:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.008676:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 34 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.008705:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 34 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.008725:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4415 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724d5 expref: 34 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.008752:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.008757:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.008766:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.008773:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.008795:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809598.008824:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.008827:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2394:x1867312335040128:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 172us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809598.008842:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.008843:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 603 00000004:00200000:3.0:1780809598.008891:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809598.008896:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809598.008911:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008922:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008930:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008936:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008944:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008951:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809598.008956:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008965:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008982:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809598.008986:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809598.008990:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.008997:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009007:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009013:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009020:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009026:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809598.009029:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009035:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009043:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91900) 00010000:00010000:3.0:1780809598.009046:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809598.009048:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009055:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009093:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009106:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 32 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.009114:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809598.009116:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809598.009119:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809598.009157:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:143094:x1867312335039744:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3211us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809598.009164:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7602 00000100:00100000:1.0:1780809598.010836:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.010889:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335040384 00000100:00100000:2.0:1780809598.010895:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335040384 00000100:00100000:2.0:1780809598.010929:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7603 00000100:00100000:2.0:1780809598.010936:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:143094:x1867312335040384:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809598.010946:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809598.010955:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724f1 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.011025:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.011046:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.011052:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.011068:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 33 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.011076:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 33 pid: 79214 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.011083:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338758272:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809598.011121:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc5cf2300 going to sleep for 11 seconds 00000100:00100000:2.0:1780809598.011762:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338758272:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809598.011776:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809598.012008:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809598.012044:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335040512 00000100:00100000:0.0:1780809598.012096:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335040512 00010000:00010000:0.0:1780809598.012122:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 34 pid: 79214 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809598.012143:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 604 00000100:00100000:0.0:1780809598.012148:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2393:x1867312335040512:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809598.012155:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809598.012159:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 34 pid: 79214 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.012169:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 34 pid: 79214 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.012180:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f447e lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ea expref: 34 pid: 79214 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.012189:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809598.012192:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.012198:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.012202:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.012215:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809598.012237:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809598.012244:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:2393:x1867312335040512:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 93us (234us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809598.012248:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809598.012257:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 604 00000004:00200000:2.0:1780809598.012262:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809598.012338:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 34 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.012359:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 33 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.012365:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.012367:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809598.012369:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:2.0:1780809598.012400:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:143094:x1867312335040384:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1464us (1564us total) trans 55834578775 rc 0/0 00000100:00100000:2.0:1780809598.012405:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7603 00000100:00100000:1.0:1780809598.039641:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809598.039691:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335040768 00000100:00100000:0.0:1780809598.039701:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335040768 00000100:00100000:0.0:1780809598.039749:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1874 00000100:00100000:0.0:1780809598.039757:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:143080:x1867312335040768:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809598.039969:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:143080:x1867312335040768:12345-192.168.203.33@tcp:35:dd.0 Request processed in 212us (336us total) trans 55834578776 rc 0/0 00000100:00100000:0.0:1780809598.039976:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1874 00000100:00100000:1.0:1780809598.108832:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809598.108904:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335041024 00000100:00100000:0.0:1780809598.108914:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335041024 00000100:00100000:0.0:1780809598.108962:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7604 00000100:00100000:0.0:1780809598.108970:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:143102:x1867312335041024:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809598.108990:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809598.109007:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f449a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724f8 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109078:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109095:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109105:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109115:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109120:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109140:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109456:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f44af lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109464:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f44af lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109470:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f44af lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809598.109477:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809598.109544:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109550:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109555:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109559:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809598.109563:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109568:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109577:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809598.109579:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809598.109613:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109619:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f44a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109634:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109638:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109642:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109646:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809598.109648:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109651:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109656:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809598.109658:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809598.109660:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109663:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f44a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109694:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f449a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f8 expref: 37 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109719:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f44af lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f8 expref: 36 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.109728:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809598.109731:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809598.109733:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf200, rc 0) 00000100:00100000:0.0:1780809598.109788:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:143102:x1867312335041024:12345-192.168.203.33@tcp:101:dd.0 Request processed in 818us (963us total) trans 55834578777 rc 0/0 00000100:00100000:0.0:1780809598.109794:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7604 00000100:00100000:1.0:1780809598.111385:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.111437:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335041152 00000100:00100000:2.0:1780809598.111443:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335041152 00000100:00100000:2.0:1780809598.111475:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2197 00000100:00100000:2.0:1780809598.111480:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf65cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2393:x1867312335041152:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.111489:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.111501:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f44af lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f8 expref: 36 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.111514:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.111517:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809598.111542:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf65cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2393:x1867312335041152:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809598.111547:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2197 00000100:00100000:1.0:1780809598.249919:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.249985:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335041280 00000100:00100000:2.0:1780809598.249995:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335041280 00000100:00100000:2.0:1780809598.250078:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7605 00000100:00100000:2.0:1780809598.250090:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:143115:x1867312335041280:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809598.250115:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809598.250142:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f44bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468724ff expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250202:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250218:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250230:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250246:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250254:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250263:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250669:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250683:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 36 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250692:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250732:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 36 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.250748:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 36 pid: 77628 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.250764:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338758400:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809598.250845:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc9647a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780809598.251763:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338758400:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809598.251782:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809598.251863:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.251933:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335041536 00000100:00100000:3.0:1780809598.251939:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335041536 00000100:00100000:3.0:1780809598.251971:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1875 00000100:00100000:3.0:1780809598.251978:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:89646:x1867312335041536:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809598.252134:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:89646:x1867312335041536:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 156us (271us total) trans 55834578778 rc 0/0 00000100:00100000:3.0:1780809598.252140:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1875 00000100:00100000:1.0:1780809598.252803:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.252846:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335041664 00000100:00100000:2.0:1780809598.252850:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335041664 00010000:00010000:2.0:1780809598.252878:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 38 pid: 77628 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.252903:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 605 00000100:00100000:2.0:1780809598.252909:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2394:x1867312335041664:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.252918:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.252923:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 38 pid: 77628 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.252933:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 38 pid: 77628 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.252954:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f448c lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724f1 expref: 38 pid: 77628 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.252976:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.252980:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.252985:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.252990:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.253006:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809598.253032:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2394:x1867312335041664:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 123us (231us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809598.253037:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.253042:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 605 00010000:00010000:1.0:1780809598.253054:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809598.253082:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809598.253088:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809598.253102:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253114:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253123:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253131:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253138:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253145:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809598.253150:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253166:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253176:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809598.253179:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809598.253184:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253191:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f44c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253207:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253214:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253220:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253226:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809598.253229:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253236:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253243:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:1.0:1780809598.253246:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809598.253249:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253265:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f44cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253296:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f44bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 37 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253320:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 36 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.253328:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809598.253331:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809598.253334:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:1.0:1780809598.253368:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:143115:x1867312335041280:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3280us (3457us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809598.253377:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7605 00000100:00100000:1.0:1780809598.254996:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.255034:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335041920 00000100:00100000:3.0:1780809598.255039:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335041920 00000100:00100000:3.0:1780809598.255064:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7606 00000100:00100000:3.0:1780809598.255069:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:143115:x1867312335041920:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809598.255080:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809598.255090:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f44d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872506 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.255148:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.255158:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 37 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.255164:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.255181:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 37 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.255188:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 37 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809598.255197:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338758528:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809598.255237:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc3150540 going to sleep for 11 seconds 00000100:00100000:0.0:1780809598.256111:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.256135:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338758528:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809598.256153:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.256160:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335042048 00000100:00100000:2.0:1780809598.256166:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335042048 00010000:00010000:2.0:1780809598.256183:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 38 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.256206:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 606 00000100:00100000:2.0:1780809598.256213:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2391:x1867312335042048:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.256220:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.256225:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 38 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.256242:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 38 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.256252:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44d2 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468724ff expref: 38 pid: 80225 timeout: 1960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.256263:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.256267:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.256272:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.256277:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.256291:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809598.256307:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.256314:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.256316:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2391:x1867312335042048:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 104us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809598.256328:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 606 00000004:00200000:3.0:1780809598.256330:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809598.256414:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f44d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 38 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.256426:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 37 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.256431:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809598.256433:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809598.256435:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809598.256462:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:143115:x1867312335041920:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1392us (1468us total) trans 55834578779 rc 0/0 00000100:00100000:3.0:1780809598.256467:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7606 00000100:00100000:0.0:1780809598.274747:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.274809:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335042304 00000100:00100000:2.0:1780809598.274823:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335042304 00000100:00100000:2.0:1780809598.274892:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7607 00000100:00100000:2.0:1780809598.274903:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:143122:x1867312335042304:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809598.274923:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809598.274940:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687250d expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275016:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275028:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275036:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275046:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275050:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275055:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275356:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4503 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275363:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4503 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275368:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4503 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809598.275376:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809598.275447:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275461:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275466:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275470:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809598.275474:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275479:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275488:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809598.275490:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809598.275494:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275498:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f44f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275514:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275518:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275521:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275525:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809598.275530:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275535:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275540:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:2.0:1780809598.275541:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809598.275543:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275546:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f44fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275607:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f44ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687250d expref: 40 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275622:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4503 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687250d expref: 39 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.275627:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.275629:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809598.275631:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:2.0:1780809598.275677:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:143122:x1867312335042304:12345-192.168.203.33@tcp:101:dd.0 Request processed in 777us (941us total) trans 55834578780 rc 0/0 00000100:00100000:2.0:1780809598.275683:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7607 00000100:00100000:1.0:1780809598.276796:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809598.276825:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.276844:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335042432 00000100:00100000:2.0:1780809598.276853:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335042432 00000100:00100000:0.0:1780809598.276861:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335042688 00000100:00100000:0.0:1780809598.276880:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335042688 00000100:00100000:2.0:1780809598.276902:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2198 00000100:00100000:2.0:1780809598.276912:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2393:x1867312335042432:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1780809598.276921:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1876 00010000:00010000:2.0:1780809598.276930:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1780809598.276932:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:143122:x1867312335042688:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809598.276946:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4503 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687250d expref: 40 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.276965:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.276969:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809598.277004:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2393:x1867312335042432:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 95us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809598.277011:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2198 00000100:00100000:0.0:1780809598.277040:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:143122:x1867312335042688:12345-192.168.203.33@tcp:35:dd.0 Request processed in 110us (213us total) trans 55834578781 rc 0/0 00000100:00100000:0.0:1780809598.277046:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1876 00000100:00100000:1.0:1780809598.448388:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.448446:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335042944 00000100:00100000:3.0:1780809598.448456:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335042944 00000100:00100000:3.0:1780809598.448503:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1877 00000100:00100000:3.0:1780809598.448512:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:143102:x1867312335042944:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809598.448774:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:143102:x1867312335042944:12345-192.168.203.33@tcp:35:dd.0 Request processed in 262us (392us total) trans 55834578782 rc 0/0 00000100:00100000:3.0:1780809598.448782:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1877 00010000:00010000:1.0:1780809598.515808:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809598.575312:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.575394:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335043200 00000100:00100000:3.0:1780809598.575410:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335043200 00000100:00100000:3.0:1780809598.575473:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7608 00000100:00100000:3.0:1780809598.575487:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:143130:x1867312335043200:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809598.575514:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809598.575538:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872514 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.575676:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.575694:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.575708:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.575727:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.575736:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.575745:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576240:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4526 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576254:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4526 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576264:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4526 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809598.576276:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809598.576376:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576398:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576406:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576414:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809598.576419:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576428:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576443:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809598.576447:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809598.576453:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576460:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576476:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576484:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576492:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576498:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809598.576509:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576518:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576528:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91900) 00010000:00010000:3.0:1780809598.576532:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809598.576536:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576543:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f451f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576623:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872514 expref: 43 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576644:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4526 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872514 expref: 42 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.576655:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809598.576659:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809598.576663:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809598.576725:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:143130:x1867312335043200:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1241us (1418us total) trans 55834578783 rc 0/0 00000100:00100000:3.0:1780809598.576736:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7608 00000100:00100000:1.0:1780809598.578144:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.578235:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335043328 00000100:00100000:2.0:1780809598.578242:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335043328 00000100:00100000:2.0:1780809598.578285:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2199 00000100:00100000:2.0:1780809598.578293:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2394:x1867312335043328:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.578303:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.578316:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4526 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872514 expref: 42 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.578328:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.578331:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809598.578361:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2394:x1867312335043328:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809598.578367:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2199 00000100:00100000:1.0:1780809598.629311:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.629367:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335043584 00000100:00100000:2.0:1780809598.629376:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335043584 00000100:00100000:2.0:1780809598.629428:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7609 00000100:00100000:2.0:1780809598.629437:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:143136:x1867312335043584:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809598.629467:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809598.629485:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687251b expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629543:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629555:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629563:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629573:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629577:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629582:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629915:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4549 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629922:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4549 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.629928:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4549 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809598.629936:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809598.630020:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630026:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630031:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630035:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809598.630038:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630043:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630052:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809598.630055:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809598.630058:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630062:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f453b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630081:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630085:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630089:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630100:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809598.630103:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630106:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630111:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:2.0:1780809598.630113:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809598.630116:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630122:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4542 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630175:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687251b expref: 44 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630188:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4549 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687251b expref: 43 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.630193:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.630195:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809598.630197:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:2.0:1780809598.630245:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:143136:x1867312335043584:12345-192.168.203.33@tcp:101:dd.0 Request processed in 810us (942us total) trans 55834578784 rc 0/0 00000100:00100000:2.0:1780809598.630251:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7609 00000100:00100000:1.0:1780809598.631335:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.631378:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335043712 00000100:00100000:2.0:1780809598.631387:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335043712 00000100:00100000:1.0:1780809598.631394:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.631429:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2200 00000100:00100000:2.0:1780809598.631438:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2392:x1867312335043712:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.631447:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.631458:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4549 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687251b expref: 43 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.631470:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.631473:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809598.631483:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335043968 00000100:00100000:0.0:1780809598.631491:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335043968 00000100:00100000:2.0:1780809598.631499:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2392:x1867312335043712:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809598.631505:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2200 00000100:00100000:0.0:1780809598.631537:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1878 00000100:00100000:0.0:1780809598.631546:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:143136:x1867312335043968:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809598.631705:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:143136:x1867312335043968:12345-192.168.203.33@tcp:35:dd.0 Request processed in 160us (314us total) trans 55834578785 rc 0/0 00000100:00100000:0.0:1780809598.631719:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1878 00000100:00100000:1.0:1780809598.792372:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809598.792417:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335044096 00000100:00100000:0.0:1780809598.792427:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335044096 00000100:00100000:0.0:1780809598.792472:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7610 00000100:00100000:0.0:1780809598.792481:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:143143:x1867312335044096:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809598.792501:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809598.792517:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4557 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872522 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792569:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792581:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792609:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792620:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792625:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792630:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792939:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792958:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 44 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792964:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.792991:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 44 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.793000:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 44 pid: 78216 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809598.793011:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade523ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338758656:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809598.793089:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd0c23780 going to sleep for 11 seconds 00000100:00100000:0.0:1780809598.793894:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade523ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338758656:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809598.793909:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809598.794063:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.794130:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335044352 00000100:00100000:3.0:1780809598.794137:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335044352 00000100:00100000:3.0:1780809598.794180:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1879 00000100:00100000:3.0:1780809598.794190:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:89646:x1867312335044352:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809598.794377:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:89646:x1867312335044352:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 187us (313us total) trans 55834578786 rc 0/0 00000100:00100000:3.0:1780809598.794387:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1879 00000100:00100000:1.0:1780809598.795035:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.795083:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335044480 00000100:00100000:2.0:1780809598.795088:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335044480 00010000:00010000:2.0:1780809598.795107:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 46 pid: 78216 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.795138:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 607 00000100:00100000:2.0:1780809598.795144:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2393:x1867312335044480:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.795152:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.795158:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 46 pid: 78216 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.795169:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 46 pid: 78216 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.795184:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f44e0 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872506 expref: 46 pid: 78216 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.795202:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.795205:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.795211:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.795215:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.795230:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809598.795257:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2393:x1867312335044480:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 111us (221us total) trans 0 rc 0/0 00010000:00010000:0.0:1780809598.795257:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.795271:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 607 00010000:00010000:0.0:1780809598.795272:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809598.795297:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809598.795300:0:77629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809598.795312:0:77629:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795329:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795336:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795341:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795346:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795384:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809598.795388:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795394:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795401:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809598.795403:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809598.795406:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795410:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f455e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795423:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795427:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795436:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795440:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cfa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809598.795442:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795445:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795450:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809598.795451:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809598.795453:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795457:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4565 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795479:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 45 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795487:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809598.795493:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809598.795494:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809598.795496:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf000, rc 0) 00000100:00100000:0.0:1780809598.795526:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:143143:x1867312335044096:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3047us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809598.795538:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7610 00000100:00100000:1.0:1780809598.796997:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.797039:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335044736 00000100:00100000:2.0:1780809598.797044:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335044736 00000100:00100000:2.0:1780809598.797072:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7611 00000100:00100000:2.0:1780809598.797078:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:143143:x1867312335044736:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809598.797087:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809598.797097:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872529 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.797150:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.797159:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 45 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.797173:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.797188:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 45 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.797195:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 45 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.797203:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338758784:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809598.797238:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc5cf2300 going to sleep for 11 seconds 00000100:00100000:2.0:1780809598.797841:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338758784:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809598.797858:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809598.798026:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.798062:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335044864 00000100:00100000:2.0:1780809598.798067:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335044864 00010000:00010000:2.0:1780809598.798082:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 46 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.798105:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 608 00000100:00100000:2.0:1780809598.798110:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2394:x1867312335044864:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809598.798118:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809598.798130:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 46 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.798158:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 46 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.798175:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f456c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872522 expref: 46 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.798191:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809598.798195:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.798204:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.798212:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809598.798235:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809598.798264:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:2394:x1867312335044864:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 152us (237us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809598.798267:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809598.798274:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 608 00010000:00010000:1.0:1780809598.798282:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809598.798292:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809598.798360:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 46 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.798384:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 45 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809598.798390:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809598.798392:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809598.798394:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:1.0:1780809598.798425:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:143143:x1867312335044736:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1347us (1431us total) trans 55834578787 rc 0/0 00000100:00100000:1.0:1780809598.798430:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7611 00000100:00100000:1.0:1780809598.835780:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338758912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780809598.835846:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809598.835948:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338758912 00000100:00100000:0.0:1780809598.835958:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338758912 00000100:00100000:0.0:1780809598.836012:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1780809598.836026:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338758912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780809598.836164:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1780809598.836224:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338758912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809598.836233:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1780809598.836271:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338758912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780809598.883209:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.883327:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335045120 00000100:00100000:3.0:1780809598.883336:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335045120 00000100:00100000:3.0:1780809598.883394:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7612 00000100:00100000:3.0:1780809598.883405:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:143150:x1867312335045120:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809598.883429:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809598.883449:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872530 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883511:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883523:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883531:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883541:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883546:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883550:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883914:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f459d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883927:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f459d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.883933:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f459d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809598.883941:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809598.884012:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884018:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884023:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884027:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809598.884030:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884034:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884043:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809598.884045:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809598.884048:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884053:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f458f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884071:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884075:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884079:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884082:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809598.884084:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884088:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884092:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91900) 00010000:00010000:3.0:1780809598.884094:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809598.884095:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884099:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884129:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872530 expref: 48 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884139:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f459d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872530 expref: 47 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809598.884152:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809598.884153:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809598.884155:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030e00, rc 0) 00000100:00100000:3.0:1780809598.884205:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:143150:x1867312335045120:12345-192.168.203.33@tcp:101:dd.0 Request processed in 804us (1004us total) trans 55834578788 rc 0/0 00000100:00100000:3.0:1780809598.884211:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7612 00000100:00100000:2.0:1780809598.885440:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809598.885469:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809598.885480:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335045248 00000100:00100000:0.0:1780809598.885486:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335045248 00000100:00100000:3.0:1780809598.885514:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335045504 00000100:00100000:3.0:1780809598.885521:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335045504 00000100:00100000:0.0:1780809598.885525:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2201 00000100:00100000:0.0:1780809598.885536:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2393:x1867312335045248:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809598.885545:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809598.885559:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f459d lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872530 expref: 48 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809598.885568:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1880 00010000:00010000:0.0:1780809598.885575:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809598.885581:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809598.885582:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:143150:x1867312335045504:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809598.885636:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2393:x1867312335045248:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 102us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809598.885645:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2201 00000100:00100000:3.0:1780809598.885746:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:143150:x1867312335045504:12345-192.168.203.33@tcp:35:dd.0 Request processed in 168us (276us total) trans 55834578789 rc 0/0 00000100:00100000:3.0:1780809598.885755:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1880 00000100:00100000:2.0:1780809598.925959:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809598.926031:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335045760 00000100:00100000:3.0:1780809598.926041:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335045760 00000100:00100000:3.0:1780809598.926089:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1881 00000100:00100000:3.0:1780809598.926098:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:143130:x1867312335045760:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809598.926311:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:143130:x1867312335045760:12345-192.168.203.33@tcp:35:dd.0 Request processed in 213us (357us total) trans 55834578790 rc 0/0 00000100:00100000:3.0:1780809598.926319:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1881 00000100:00100000:0.0:1780809599.053530:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.053618:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335046016 00000100:00100000:2.0:1780809599.053628:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335046016 00000100:00100000:2.0:1780809599.053675:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7613 00000100:00100000:2.0:1780809599.053698:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:143158:x1867312335046016:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809599.053723:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809599.053744:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872537 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.053807:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.053819:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.053828:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.053837:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.053842:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.053849:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054214:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f45c0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054222:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f45c0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054228:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f45c0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809599.054246:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809599.054316:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054322:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054327:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054331:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809599.054335:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054340:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054349:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809599.054351:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809599.054355:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054359:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f45b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054380:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054384:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054395:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054399:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809599.054401:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054405:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054409:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:2.0:1780809599.054411:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809599.054413:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054416:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054447:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872537 expref: 51 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054465:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f45c0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872537 expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.054470:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.054471:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809599.054473:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:2.0:1780809599.054523:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:143158:x1867312335046016:12345-192.168.203.33@tcp:101:dd.0 Request processed in 828us (1000us total) trans 55834578791 rc 0/0 00000100:00100000:2.0:1780809599.054536:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7613 00000100:00100000:1.0:1780809599.055639:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.055675:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335046144 00000100:00100000:2.0:1780809599.055681:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335046144 00000100:00100000:2.0:1780809599.055716:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2202 00000100:00100000:2.0:1780809599.055723:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2391:x1867312335046144:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.055731:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.055744:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f45c0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872537 expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.055760:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.055763:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809599.055789:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2391:x1867312335046144:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809599.055799:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2202 00000100:00100000:1.0:1780809599.335818:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809599.335913:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335046400 00000100:00100000:3.0:1780809599.335923:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335046400 00000100:00100000:3.0:1780809599.335974:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7614 00000100:00100000:3.0:1780809599.335984:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:143171:x1867312335046400:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809599.336020:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809599.336042:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f45ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687253e expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336130:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336147:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336159:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336171:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336176:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336180:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336466:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f45e3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336474:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f45e3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336479:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f45e3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809599.336486:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809599.336565:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336571:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336575:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336580:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809599.336583:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336622:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336632:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809599.336634:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809599.336638:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336642:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f45d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336652:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336656:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336661:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336672:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809599.336674:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336678:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336683:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91900) 00010000:00010000:3.0:1780809599.336684:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809599.336686:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336689:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f45dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336722:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f45ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687253e expref: 52 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336731:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f45e3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687253e expref: 51 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.336737:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809599.336738:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809599.336740:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030400, rc 0) 00000100:00100000:3.0:1780809599.336786:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:143171:x1867312335046400:12345-192.168.203.33@tcp:101:dd.0 Request processed in 806us (977us total) trans 55834578792 rc 0/0 00000100:00100000:3.0:1780809599.336792:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7614 00000100:00100000:0.0:1780809599.337986:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809599.338013:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809599.338052:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335046784 00000100:00100000:3.0:1780809599.338066:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335046784 00000100:00100000:2.0:1780809599.338076:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335046528 00000100:00100000:2.0:1780809599.338080:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335046528 00000100:00100000:3.0:1780809599.338108:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1882 00000100:00100000:2.0:1780809599.338113:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2203 00000100:00100000:3.0:1780809599.338117:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:143171:x1867312335046784:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809599.338120:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2394:x1867312335046528:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.338132:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.338148:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f45e3 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687253e expref: 52 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.338164:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.338169:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809599.338203:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2394:x1867312335046528:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809599.338221:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2203 00000100:00100000:3.0:1780809599.338231:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:143171:x1867312335046784:12345-192.168.203.33@tcp:35:dd.0 Request processed in 115us (216us total) trans 55834578793 rc 0/0 00000100:00100000:3.0:1780809599.338239:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1882 00000100:00100000:1.0:1780809599.392695:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809599.392775:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335047040 00000100:00100000:3.0:1780809599.392785:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335047040 00000100:00100000:3.0:1780809599.392836:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1883 00000100:00100000:3.0:1780809599.392849:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:143158:x1867312335047040:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809599.393073:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:143158:x1867312335047040:12345-192.168.203.33@tcp:35:dd.0 Request processed in 227us (384us total) trans 55834578794 rc 0/0 00000100:00100000:3.0:1780809599.393080:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1883 00000100:00100000:1.0:1780809599.525290:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.525341:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335047168 00000100:00100000:2.0:1780809599.525351:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335047168 00000100:00100000:2.0:1780809599.525408:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7615 00000100:00100000:2.0:1780809599.525418:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:143179:x1867312335047168:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809599.525437:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809599.525455:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f45f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872545 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525507:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525519:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525527:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525537:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525542:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525546:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525880:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525898:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 53 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525904:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525930:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 53 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.525940:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 53 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809599.525950:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338759040:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809599.526014:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc3e00900 going to sleep for 11 seconds 00000100:00100000:2.0:1780809599.526760:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338759040:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809599.526775:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809599.526921:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809599.526966:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335047424 00000100:00100000:3.0:1780809599.526970:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335047424 00000100:00100000:3.0:1780809599.526997:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1884 00000100:00100000:3.0:1780809599.527006:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:90168:x1867312335047424:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809599.527191:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:90168:x1867312335047424:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 184us (269us total) trans 55834578795 rc 0/0 00000100:00100000:3.0:1780809599.527200:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1884 00000100:00100000:0.0:1780809599.527984:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.528034:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335047552 00000100:00100000:2.0:1780809599.528039:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335047552 00010000:00010000:2.0:1780809599.528055:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 55 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809599.528078:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 609 00000100:00100000:2.0:1780809599.528086:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2393:x1867312335047552:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.528097:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.528110:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 55 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.528123:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 55 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.528138:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f457a lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872529 expref: 55 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.528159:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.528163:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.528169:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.528173:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.528192:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809599.528226:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2393:x1867312335047552:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 140us (243us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809599.528229:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809599.528235:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 609 00010000:00010000:1.0:1780809599.528238:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809599.528265:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809599.528270:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809599.528284:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528294:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528301:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528307:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528311:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528315:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809599.528318:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528323:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528330:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809599.528338:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809599.528341:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528346:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f45f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528377:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528382:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528386:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528390:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809599.528392:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528396:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528405:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54200) 00010000:00010000:1.0:1780809599.528406:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809599.528408:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528412:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f45ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528435:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f45f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 54 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528460:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 53 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.528468:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809599.528471:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809599.528474:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f800, rc 0) 00000100:00100000:1.0:1780809599.528511:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:143179:x1867312335047168:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3094us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809599.528519:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7615 00000100:00100000:0.0:1780809599.529903:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809599.529945:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335047808 00000100:00100000:1.0:1780809599.529950:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335047808 00000100:00100000:1.0:1780809599.529986:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7616 00000100:00100000:1.0:1780809599.529995:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:143179:x1867312335047808:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809599.530009:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809599.530020:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f460d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687254c expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.530085:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.530097:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 54 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.530102:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.530126:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 54 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.530141:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 54 pid: 77628 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809599.530149:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338759168:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809599.530186:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf563eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1780809599.530890:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338759168:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809599.530907:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809599.531063:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.531096:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335047936 00000100:00100000:2.0:1780809599.531101:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335047936 00010000:00010000:2.0:1780809599.531123:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 55 pid: 77628 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809599.531152:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 610 00000100:00100000:2.0:1780809599.531162:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2394:x1867312335047936:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.531180:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.531187:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 55 pid: 77628 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.531199:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 55 pid: 77628 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.531215:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4606 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872545 expref: 55 pid: 77628 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.531233:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.531238:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.531247:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.531254:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.531275:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809599.531289:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.531298:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809599.531306:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2394:x1867312335047936:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 145us (241us total) trans 0 rc 0/0 00000004:00200000:1.0:1780809599.531308:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809599.531319:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 610 00010000:00010000:1.0:1780809599.531403:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f460d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 55 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.531416:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 54 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.531422:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809599.531424:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809599.531426:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65600, rc 0) 00000100:00100000:1.0:1780809599.531455:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:143179:x1867312335047808:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1462us (1555us total) trans 55834578796 rc 0/0 00000100:00100000:1.0:1780809599.531468:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7616 00010000:00010000:1.0:1780809599.539694:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809599.656821:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809599.656890:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335048064 00000100:00100000:1.0:1780809599.656899:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335048064 00000100:00100000:1.0:1780809599.656944:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7617 00000100:00100000:1.0:1780809599.656952:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:143186:x1867312335048064:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809599.656971:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809599.656987:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872553 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657039:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657054:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657067:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657083:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657091:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657099:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657371:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657385:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 55 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657391:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657416:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 55 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.657426:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 55 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809599.657437:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338759296:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809599.657501:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf563eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1780809599.658351:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338759296:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809599.658372:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809599.658496:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809599.658542:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335048320 00000100:00100000:3.0:1780809599.658546:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335048320 00000100:00100000:3.0:1780809599.658573:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1885 00000100:00100000:3.0:1780809599.658581:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccae14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:89645:x1867312335048320:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809599.658774:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccae14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:89645:x1867312335048320:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 192us (276us total) trans 55834578797 rc 0/0 00000100:00100000:3.0:1780809599.658791:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1885 00000100:00100000:3.0:1780809599.659507:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.659554:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335048448 00000100:00100000:2.0:1780809599.659559:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335048448 00010000:00010000:2.0:1780809599.659578:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 57 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809599.659628:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 611 00000100:00100000:2.0:1780809599.659635:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312335048448:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.659645:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.659650:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 57 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.659667:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 57 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.659684:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4614 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687254c expref: 57 pid: 77629 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.659694:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.659698:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.659703:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.659708:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.659722:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809599.659745:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2393:x1867312335048448:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 112us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809599.659751:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 611 00010000:00010000:1.0:1780809599.659767:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659779:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809599.659807:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809599.659812:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809599.659826:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659876:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659889:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659906:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659915:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659922:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809599.659927:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659936:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659947:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809599.659951:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809599.659956:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659963:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659974:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659982:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.659996:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.660002:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809599.660006:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.660013:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.660022:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809599.660025:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809599.660028:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.660035:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4630 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.660066:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 56 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.660081:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 55 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809599.660090:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809599.660093:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809599.660096:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65200, rc 0) 00000100:00100000:1.0:1780809599.660134:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:143186:x1867312335048064:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3181us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809599.660152:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7617 00000100:00100000:3.0:1780809599.661851:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809599.661916:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335048704 00000100:00100000:0.0:1780809599.661922:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335048704 00000100:00100000:0.0:1780809599.661955:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7618 00000100:00100000:0.0:1780809599.661960:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:143186:x1867312335048704:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809599.661970:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809599.661980:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f463e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687255a expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.662028:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.662043:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 56 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.662048:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.662065:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 56 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.662073:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 56 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809599.662082:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caccae14000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338759424:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809599.662127:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadd0c230c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809599.662812:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caccae14000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338759424:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809599.662827:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809599.663028:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.663072:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335048832 00000100:00100000:2.0:1780809599.663085:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335048832 00010000:00010000:2.0:1780809599.663108:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 57 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809599.663145:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 612 00000100:00100000:2.0:1780809599.663155:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2394:x1867312335048832:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.663165:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.663171:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 57 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.663184:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 57 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.663201:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4637 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872553 expref: 57 pid: 80225 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.663214:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.663218:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.663226:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.663234:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.663257:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809599.663277:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.663284:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809599.663293:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809599.663294:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2394:x1867312335048832:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809599.663315:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 612 00010000:00010000:0.0:1780809599.663379:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f463e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 57 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.663395:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 56 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809599.663401:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809599.663403:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809599.663405:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfa00, rc 0) 00000100:00100000:0.0:1780809599.663481:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:143186:x1867312335048704:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1519us (1630us total) trans 55834578798 rc 0/0 00000100:00100000:0.0:1780809599.663486:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7618 00000100:00100000:3.0:1780809599.684340:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.684396:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335049088 00000100:00100000:2.0:1780809599.684406:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335049088 00000100:00100000:2.0:1780809599.684465:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7619 00000100:00100000:2.0:1780809599.684473:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:143193:x1867312335049088:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809599.684507:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809599.684527:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872561 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.684620:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.684633:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.684643:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.684653:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.684668:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.684673:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685028:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4668 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685052:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4668 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685061:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4668 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809599.685073:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809599.685174:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685184:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685203:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685210:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809599.685214:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685223:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685236:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809599.685239:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809599.685244:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685251:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f465a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685300:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685307:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685314:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685320:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809599.685324:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685331:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685340:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54a00) 00010000:00010000:2.0:1780809599.685342:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809599.685345:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685354:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4661 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685416:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872561 expref: 59 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685443:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4668 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872561 expref: 58 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.685463:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.685465:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809599.685468:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:2.0:1780809599.685535:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:143193:x1867312335049088:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1061us (1201us total) trans 55834578799 rc 0/0 00000100:00100000:2.0:1780809599.685542:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7619 00000100:00100000:3.0:1780809599.686818:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.686851:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335049216 00000100:00100000:2.0:1780809599.686880:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335049216 00000100:00100000:2.0:1780809599.686915:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2204 00000100:00100000:2.0:1780809599.686921:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5526c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:2393:x1867312335049216:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.686929:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.686941:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4668 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872561 expref: 58 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.686958:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.686962:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809599.686996:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5526c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312335049216:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809599.687005:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2204 00000100:00100000:1.0:1780809599.725068:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809599.725139:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335049472 00000100:00100000:3.0:1780809599.725148:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335049472 00000100:00100000:3.0:1780809599.725194:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7620 00000100:00100000:3.0:1780809599.725204:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:143199:x1867312335049472:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809599.725227:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809599.725248:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872568 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725324:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725339:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725349:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725364:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725373:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725403:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725759:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f468b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725771:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f468b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725778:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f468b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809599.725787:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809599.725885:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725894:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725902:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725907:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809599.725911:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725916:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725925:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809599.725928:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809599.725937:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725942:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f467d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725951:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725955:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725959:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725962:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809599.725964:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725967:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725972:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91900) 00010000:00010000:3.0:1780809599.725973:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809599.725975:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.725978:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4684 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.726008:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872568 expref: 60 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.726026:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f468b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872568 expref: 59 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809599.726032:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809599.726034:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809599.726036:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:3.0:1780809599.726085:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:143199:x1867312335049472:12345-192.168.203.33@tcp:101:dd.0 Request processed in 884us (1025us total) trans 55834578800 rc 0/0 00000100:00100000:3.0:1780809599.726090:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7620 00000100:00100000:3.0:1780809599.727229:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.727277:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335049600 00000100:00100000:3.0:1780809599.727278:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.727283:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335049600 00000100:00100000:2.0:1780809599.727322:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2205 00000100:00100000:0.0:1780809599.727324:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335049856 00000100:00100000:2.0:1780809599.727330:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2394:x1867312335049600:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.727339:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809599.727360:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f468b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872568 expref: 59 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809599.727374:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335049856 00010000:00010000:2.0:1780809599.727375:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.727382:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809599.727416:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1886 00000100:00100000:2.0:1780809599.727423:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2394:x1867312335049600:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 92us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809599.727426:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:143199:x1867312335049856:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809599.727441:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2205 00000100:00100000:0.0:1780809599.727616:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:143199:x1867312335049856:12345-192.168.203.33@tcp:35:dd.0 Request processed in 191us (339us total) trans 55834578801 rc 0/0 00000100:00100000:0.0:1780809599.727624:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1886 00000100:00100000:1.0:1780809599.859777:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caccae14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338759680:0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.859796:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338759552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809599.859887:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809599.859888:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809599.859923:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338759680 00000100:00100000:0.0:1780809599.859932:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338759680 00000100:00100000:3.0:1780809599.859937:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caccae16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338760192:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.859945:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadc40c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338760064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780809599.859973:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809599.859983:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809599.860002:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1780809599.860004:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfdbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338760704:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860011:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfdbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338760576:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860019:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc65c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338759680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.860038:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809599.860048:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809599.860062:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3444:1867312338761216:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860077:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1867312338761088:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860093:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc65c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338759680:12345-0@lo:400:kworker.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809599.860098:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809599.860109:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1780809599.860132:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338759552 00000100:00100000:1.0:1780809599.860133:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760576 00000100:00100000:3.0:1780809599.860139:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1780809599.860140:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338759552 00000100:00100000:1.0:1780809599.860141:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760576 00000100:00100000:3.0:1780809599.860154:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338759808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780809599.860168:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809599.860189:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1780809599.860196:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809599.860201:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338760576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809599.860211:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760064 00000100:00100000:0.0:1780809599.860216:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caccae14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338759680:0@lo:400:kworker.0 00000100:00100000:2.0:1780809599.860217:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760064 00000100:00100000:3.0:1780809599.860227:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caccae17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338760320:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860248:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338760576:12345-0@lo:400:kworker.0 Request processed in 50us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809599.860252:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338759808 00000100:00100000:1.0:1780809599.860257:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1780809599.860258:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338759808 00000100:00100000:0.0:1780809599.860261:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfdbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338760576:0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.860266:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809599.860282:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1780809599.860295:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caccae16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338759936:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860296:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338761216 00000100:00100000:3.0:1780809599.860302:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfdbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338760832:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860302:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338761216 00000100:00100000:1.0:1780809599.860339:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338761088 00000100:00100000:1.0:1780809599.860343:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338761088 00000100:00100000:3.0:1780809599.860351:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809599.860353:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809599.860379:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1780809599.860384:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1780809599.860386:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1867312338761344:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860392:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3444:x1867312338761216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860395:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caccae14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338760448:0@lo:400:kworker.0 00000100:00100000:2.0:1780809599.860400:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338759552:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809599.860429:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1780809599.860433:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:1.0:1780809599.860442:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3444:x1867312338761216:12345-0@lo:400:kworker.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809599.860450:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1780809599.860455:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338759936 00000100:00100000:0.0:1780809599.860462:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338759936 00000100:00100000:1.0:1780809599.860476:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338761344 00010000:00080000:3.0:1780809599.860481:0:3444:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc4634a80 x1867312338761216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780809599.860482:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338761344 00000100:00100000:2.0:1780809599.860494:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338759552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809599.860498:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3444:1867312338761216:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860507:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1780809599.860512:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1780809599.860519:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1780809599.860525:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338759552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780809599.860525:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338759936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860533:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1867312338761088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809599.860540:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1780809599.860553:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338760064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780809599.860567:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:3.0:1780809599.860573:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760192 00000100:00100000:3.0:1780809599.860578:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760192 00000100:00100000:1.0:1780809599.860579:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1867312338761088:12345-0@lo:400:kworker.0 Request processed in 52us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809599.860610:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1780809599.860616:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338759936:12345-0@lo:400:kworker.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809599.860628:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1780809599.860631:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1780809599.860643:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760704 00000100:00100000:1.0:1780809599.860644:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccdc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1867312338761344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809599.860645:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338760064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809599.860648:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760704 00000100:00100000:2.0:1780809599.860658:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1780809599.860681:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760320 00000100:00100000:3.0:1780809599.860685:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760320 00000100:00100000:2.0:1780809599.860689:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1780809599.860690:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760832 00000100:00100000:1.0:1780809599.860694:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccdc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1867312338761344:12345-0@lo:400:kworker.0 Request processed in 54us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809599.860698:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760832 00000100:00100000:1.0:1780809599.860703:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1780809599.860708:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1780809599.860709:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3444:x1867312338759808:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809599.860721:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338760192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860734:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00002000:00000024:2.0:1780809599.860742:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:1.0:1780809599.860745:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1867312338761344:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860750:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3444:x1867312338760704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.860768:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caccae16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338760192:0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.860769:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338760192:12345-0@lo:400:kworker.0 Request processed in 51us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809599.860780:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1780809599.860806:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1780809599.860807:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3444:x1867312338759808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809599.860814:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cade522b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338759808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809599.860817:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338760320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860817:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3444:x1867312338760704:12345-0@lo:400:kworker.0 Request processed in 69us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809599.860830:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1780809599.860834:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfdbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338760704:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860836:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1780809599.860881:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338760320:12345-0@lo:400:kworker.0 Request processed in 66us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809599.860886:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caccae17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338760320:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.860886:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00080000:2.0:1780809599.860894:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780809599.860898:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00080000:2.0:1780809599.860905:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809599.860905:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338760832:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780809599.860912:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780809599.860916:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780809599.860963:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809599.860963:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338760832:12345-0@lo:400:kworker.0 Request processed in 63us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809599.860975:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1780809599.860983:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfdbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338760832:0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.861000:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfdbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338760960:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.861006:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760448 00000100:00100000:1.0:1780809599.861011:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760448 00000100:00100000:1.0:1780809599.861038:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1780809599.861045:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338760448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.861053:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809599.861088:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf5456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338761472:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.861089:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338760448:12345-0@lo:400:kworker.0 Request processed in 42us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809599.861111:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1780809599.861131:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338760960 00000100:00100000:3.0:1780809599.861132:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809599.861137:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338760960 00000100:00100000:2.0:1780809599.861173:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338761472 00000100:00100000:2.0:1780809599.861178:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338761472 00000100:00100000:3.0:1780809599.861179:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadc40c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338760064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780809599.861184:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00080000:2.0:1780809599.861198:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780809599.861198:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338760960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.861205:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1867312338761088:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.861242:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1780809599.861250:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caccae16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338759936:0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.861251:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338760960:12345-0@lo:400:kworker.0 Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809599.861254:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338761472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809599.861266:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1780809599.861284:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caccae14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338760448:0@lo:400:kworker.0 00000100:00100000:3.0:1780809599.861304:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfdbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338760960:0@lo:400:kworker.0 00010000:00080000:3.0:1780809599.861318:0:3443:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadf5456300 x1867312338761472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780809599.861330:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf5456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338761472:0@lo:400:kworker.0 00000100:00100000:0.0:1780809599.861333:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338761472:12345-0@lo:400:kworker.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809599.861342:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1780809599.886800:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.886879:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335050112 00000100:00100000:2.0:1780809599.886888:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335050112 00000100:00100000:2.0:1780809599.886942:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7621 00000100:00100000:2.0:1780809599.886951:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:143206:x1867312335050112:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809599.886972:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809599.886988:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4699 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687256f expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887047:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887058:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887068:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887077:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887107:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887113:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887445:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46ae lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887454:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46ae lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887459:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46ae lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809599.887467:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809599.887550:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887557:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887562:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887566:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809599.887570:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887575:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887616:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809599.887619:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809599.887623:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887627:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887648:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887652:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887656:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887660:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809599.887661:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887665:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887669:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54a00) 00010000:00010000:2.0:1780809599.887671:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809599.887672:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887676:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887730:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4699 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687256f expref: 62 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887741:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46ae lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687256f expref: 61 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809599.887747:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.887748:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809599.887750:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:2.0:1780809599.887795:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:143206:x1867312335050112:12345-192.168.203.33@tcp:101:dd.0 Request processed in 846us (1005us total) trans 55834578802 rc 0/0 00000100:00100000:2.0:1780809599.887801:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7621 00000100:00100000:1.0:1780809599.888997:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.889031:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335050240 00000100:00100000:2.0:1780809599.889036:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335050240 00000100:00100000:1.0:1780809599.889044:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809599.889074:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2206 00000100:00100000:2.0:1780809599.889082:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade522b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2393:x1867312335050240:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809599.889090:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809599.889101:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335050496 00010000:00010000:2.0:1780809599.889103:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46ae lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687256f expref: 61 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809599.889109:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335050496 00010000:00010000:2.0:1780809599.889120:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809599.889126:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809599.889157:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1887 00000100:00100000:2.0:1780809599.889166:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade522b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2393:x1867312335050240:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 82us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809599.889170:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:143206:x1867312335050496:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809599.889185:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2206 00000100:00100000:3.0:1780809599.889296:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:143206:x1867312335050496:12345-192.168.203.33@tcp:35:dd.0 Request processed in 130us (250us total) trans 55834578803 rc 0/0 00000100:00100000:3.0:1780809599.889307:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1887 00000100:00100000:1.0:1780809600.032691:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809600.032740:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335050752 00000100:00100000:0.0:1780809600.032750:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335050752 00000100:00080000:2.0:1780809600.032806:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809600.032818:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1888 00000100:00100000:0.0:1780809600.032831:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:143193:x1867312335050752:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809600.033051:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:143193:x1867312335050752:12345-192.168.203.33@tcp:35:dd.0 Request processed in 223us (368us total) trans 55834578804 rc 0/0 00000100:00100000:0.0:1780809600.033057:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1888 00000100:00100000:1.0:1780809600.342574:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.342632:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335051008 00000100:00100000:2.0:1780809600.342641:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335051008 00000100:00100000:2.0:1780809600.342685:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7622 00000100:00100000:2.0:1780809600.342692:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:143221:x1867312335051008:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809600.342712:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809600.342729:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872576 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.342794:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.342806:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.342814:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.342824:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.342829:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.342833:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343175:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46d1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343187:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46d1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343204:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46d1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809600.343213:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809600.343286:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343292:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343297:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343301:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809600.343305:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343310:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343319:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809600.343321:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809600.343325:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343329:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343351:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343370:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343378:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343384:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809600.343388:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343394:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343400:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54a00) 00010000:00010000:2.0:1780809600.343402:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809600.343404:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343408:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343442:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872576 expref: 65 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343460:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46d1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872576 expref: 64 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.343465:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.343467:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809600.343474:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f800, rc 0) 00000100:00100000:2.0:1780809600.343520:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:143221:x1867312335051008:12345-192.168.203.33@tcp:101:dd.0 Request processed in 829us (954us total) trans 55834578805 rc 0/0 00000100:00100000:2.0:1780809600.343526:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7622 00000100:00100000:0.0:1780809600.344710:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.344746:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335051136 00000100:00100000:2.0:1780809600.344751:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335051136 00000100:00100000:2.0:1780809600.344785:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2207 00000100:00100000:2.0:1780809600.344791:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2394:x1867312335051136:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809600.344799:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809600.344810:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46d1 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872576 expref: 64 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.344822:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.344825:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809600.344847:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2394:x1867312335051136:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809600.344875:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2207 00000100:00100000:1.0:1780809600.371806:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338761600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780809600.371901:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809600.371954:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338761600 00000100:00100000:1.0:1780809600.371960:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338761600 00000100:00100000:1.0:1780809600.371999:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1780809600.372009:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfca97050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338761600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780809600.372055:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:1.0:1780809600.372108:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfca97050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338761600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809600.372117:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1780809600.372195:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338761600:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1780809600.372292:0:78218:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1780809600.394545:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.394630:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335051264 00000100:00100000:2.0:1780809600.394641:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335051264 00000100:00100000:2.0:1780809600.394691:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7623 00000100:00100000:2.0:1780809600.394700:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:143227:x1867312335051264:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809600.394721:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809600.394737:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687257d expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.394789:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.394820:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.394829:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.394846:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.394865:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.394871:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.395152:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.395161:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 64 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.395167:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.395202:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 64 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.395217:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 64 pid: 78216 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.395242:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338761728:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809600.395305:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc12ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780809600.396254:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338761728:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809600.396268:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809600.396368:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809600.396454:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335051520 00000100:00100000:3.0:1780809600.396466:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335051520 00000100:00100000:3.0:1780809600.396537:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1889 00000100:00100000:3.0:1780809600.396549:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:90168:x1867312335051520:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809600.396837:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:90168:x1867312335051520:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 290us (469us total) trans 55834578806 rc 0/0 00000100:00100000:3.0:1780809600.396847:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1889 00000100:00100000:1.0:1780809600.397643:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.397691:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335051648 00000100:00100000:2.0:1780809600.397697:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335051648 00010000:00010000:2.0:1780809600.397717:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 66 pid: 78216 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.397742:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 613 00000100:00100000:2.0:1780809600.397749:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2393:x1867312335051648:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809600.397757:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809600.397762:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 66 pid: 78216 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.397772:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 66 pid: 78216 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.397786:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4645 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687255a expref: 66 pid: 78216 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.397802:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.397806:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.397818:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.397823:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.397839:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809600.397865:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397874:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.397891:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312335051648:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 140us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809600.397902:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 613 00000004:00200000:0.0:1780809600.397906:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809600.397911:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809600.397926:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397935:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397943:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397948:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397953:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397957:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809600.397960:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397965:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397972:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809600.397975:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809600.397977:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.397988:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f46e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398052:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398061:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398068:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398074:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809600.398078:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398085:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398094:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54a00) 00010000:00010000:0.0:1780809600.398097:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809600.398101:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398109:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f46ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398154:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f46df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 65 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398187:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 64 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.398196:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809600.398199:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809600.398202:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:0.0:1780809600.398242:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:143227:x1867312335051264:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3542us (3705us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809600.398258:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7623 00000100:00100000:1.0:1780809600.399739:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809600.399771:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335051904 00000100:00100000:0.0:1780809600.399778:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335051904 00000100:00100000:0.0:1780809600.399810:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7624 00000100:00100000:0.0:1780809600.399819:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:143227:x1867312335051904:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809600.399834:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809600.399845:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f46fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872584 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.399905:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.399914:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 65 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.399920:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.399936:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 65 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.399950:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 65 pid: 80225 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809600.399959:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf60d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338761856:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809600.399996:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf6ec2840 going to sleep for 11 seconds 00000100:00100000:0.0:1780809600.400679:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf60d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338761856:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809600.400691:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809600.400967:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.401012:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335052032 00000100:00100000:2.0:1780809600.401025:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335052032 00010000:00010000:2.0:1780809600.401045:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 66 pid: 80225 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.401073:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 614 00000100:00100000:2.0:1780809600.401084:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2394:x1867312335052032:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809600.401093:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809600.401100:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 66 pid: 80225 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.401113:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 66 pid: 80225 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.401127:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f46f4 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687257d expref: 66 pid: 80225 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.401155:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.401160:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.401169:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.401175:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.401194:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809600.401205:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.401213:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.401223:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2394:x1867312335052032:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 143us (258us total) trans 0 rc 0/0 00000004:00200000:0.0:1780809600.401225:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809600.401231:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 614 00010000:00010000:0.0:1780809600.401330:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f46fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 66 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.401344:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 65 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.401349:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809600.401351:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809600.401353:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfe00, rc 0) 00000100:00100000:0.0:1780809600.401415:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:143227:x1867312335051904:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1596us (1675us total) trans 55834578807 rc 0/0 00000100:00100000:0.0:1780809600.401429:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7624 00000100:00100000:1.0:1780809600.462325:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.462392:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335052288 00000100:00100000:2.0:1780809600.462403:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335052288 00000100:00100000:2.0:1780809600.462452:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7625 00000100:00100000:2.0:1780809600.462461:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc93e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:143234:x1867312335052288:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809600.462482:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809600.462499:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687258b expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462562:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462574:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462623:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462634:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462639:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462643:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462978:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4725 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462985:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4725 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.462991:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4725 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809600.462998:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809600.463076:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463082:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463087:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463091:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809600.463099:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463105:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463122:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809600.463124:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809600.463128:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463132:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463153:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463157:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463161:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463165:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809600.463167:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463172:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463180:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54100) 00010000:00010000:2.0:1780809600.463182:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809600.463193:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463200:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f471e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463253:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687258b expref: 68 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463272:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4725 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687258b expref: 67 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.463277:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.463279:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809600.463281:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809600.463330:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc93e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:143234:x1867312335052288:12345-192.168.203.33@tcp:101:dd.0 Request processed in 871us (1013us total) trans 55834578808 rc 0/0 00000100:00100000:2.0:1780809600.463336:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7625 00000100:00100000:2.0:1780809600.464530:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.464567:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809600.464581:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335052672 00000100:00100000:0.0:1780809600.464616:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335052672 00000100:00100000:1.0:1780809600.464619:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335052416 00000100:00100000:1.0:1780809600.464624:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335052416 00000100:00100000:0.0:1780809600.464665:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1890 00000100:00100000:1.0:1780809600.464669:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2208 00000100:00100000:0.0:1780809600.464686:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:143234:x1867312335052672:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809600.464694:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2392:x1867312335052416:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809600.464708:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809600.464726:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4725 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687258b expref: 68 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.464749:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809600.464754:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809600.464796:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2392:x1867312335052416:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809600.464804:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2208 00000100:00100000:0.0:1780809600.464830:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:143234:x1867312335052672:12345-192.168.203.33@tcp:35:dd.0 Request processed in 149us (295us total) trans 55834578809 rc 0/0 00000100:00100000:0.0:1780809600.464841:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1890 00010000:00010000:1.0:1780809600.563816:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809600.681395:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809600.681468:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335052928 00000100:00100000:3.0:1780809600.681481:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335052928 00000100:00100000:3.0:1780809600.681540:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1891 00000100:00100000:3.0:1780809600.681549:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc93e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:143221:x1867312335052928:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809600.681865:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc93e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:143221:x1867312335052928:12345-192.168.203.33@tcp:35:dd.0 Request processed in 302us (467us total) trans 55834578810 rc 0/0 00000100:00100000:3.0:1780809600.681874:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1891 00000100:00100000:3.0:1780809600.808341:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809600.808405:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335053184 00000100:00100000:0.0:1780809600.808419:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335053184 00000100:00100000:0.0:1780809600.808500:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7626 00000100:00100000:0.0:1780809600.808515:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:143243:x1867312335053184:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809600.808549:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809600.808579:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872592 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.808713:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.808732:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.808748:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.808766:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.808797:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.808806:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809374:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4748 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809382:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4748 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809388:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4748 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809600.809399:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809600.809493:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809500:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809505:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809510:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809600.809514:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809521:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809543:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809600.809545:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809600.809550:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809555:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f473a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809574:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809577:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809581:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809585:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809600.809621:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809625:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809631:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809600.809633:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809600.809636:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809641:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809693:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872592 expref: 71 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809705:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4748 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872592 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809600.809710:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809600.809712:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809600.809714:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf800, rc 0) 00000100:00100000:0.0:1780809600.809777:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:143243:x1867312335053184:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1267us (1452us total) trans 55834578811 rc 0/0 00000100:00100000:0.0:1780809600.809783:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7626 00000100:00100000:2.0:1780809600.811004:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809600.811066:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335053312 00000100:00100000:1.0:1780809600.811073:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335053312 00000100:00100000:1.0:1780809600.811133:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2209 00000100:00100000:1.0:1780809600.811145:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:2393:x1867312335053312:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809600.811160:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809600.811177:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4748 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872592 expref: 70 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.811196:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809600.811201:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809600.811245:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:2393:x1867312335053312:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809600.811255:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2209 00000100:00100000:1.0:1780809600.835363:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.835468:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335053440 00000100:00100000:2.0:1780809600.835481:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335053440 00000100:00100000:2.0:1780809600.835542:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7627 00000100:00100000:2.0:1780809600.835552:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:143249:x1867312335053440:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809600.835578:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809600.835628:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872599 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.835721:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.835737:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.835747:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.835759:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.835764:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.835768:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.836157:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.836167:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 70 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.836173:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.836206:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 70 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.836227:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 70 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.836240:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338761984:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809600.836337:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc5cf2300 going to sleep for 11 seconds 00000100:00100000:2.0:1780809600.837179:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338761984:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809600.837198:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809600.837309:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809600.837346:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335053696 00000100:00100000:0.0:1780809600.837391:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335053696 00000100:00100000:0.0:1780809600.837432:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1892 00000100:00100000:0.0:1780809600.837441:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:89645:x1867312335053696:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809600.837643:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:89645:x1867312335053696:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 204us (334us total) trans 55834578812 rc 0/0 00000100:00100000:0.0:1780809600.837650:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1892 00000100:00100000:3.0:1780809600.838377:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.838443:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335053824 00000100:00100000:2.0:1780809600.838449:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335053824 00010000:00010000:2.0:1780809600.838474:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 72 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.838507:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 615 00000100:00100000:2.0:1780809600.838517:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2394:x1867312335053824:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809600.838530:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809600.838539:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 72 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.838553:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 72 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.838574:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4702 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872584 expref: 72 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.838639:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.838645:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.838655:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.838662:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.838691:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809600.838717:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.838731:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2394:x1867312335053824:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 213us (352us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809600.838731:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809600.838747:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 615 00000004:00200000:1.0:1780809600.838773:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809600.838780:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809600.838797:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838810:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838821:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838830:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838838:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838844:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809600.838865:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838884:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838892:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809600.838895:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809600.838899:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838904:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f475d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838917:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838922:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838926:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838929:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809600.838931:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838935:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838939:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54100) 00010000:00010000:1.0:1780809600.838940:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809600.838942:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838954:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.838983:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 71 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.839005:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 70 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.839011:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809600.839013:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809600.839015:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e400, rc 0) 00000100:00100000:1.0:1780809600.839043:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:143249:x1867312335053440:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3493us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809600.839048:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7627 00000100:00100000:3.0:1780809600.840422:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809600.840460:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335054080 00000100:00100000:1.0:1780809600.840466:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335054080 00000100:00100000:1.0:1780809600.840496:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7628 00000100:00100000:1.0:1780809600.840501:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:143249:x1867312335054080:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809600.840511:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809600.840520:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725a0 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.840573:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.840581:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 71 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.840615:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.840640:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 71 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.840654:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 71 pid: 77628 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809600.840666:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc556d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338762112:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809600.840712:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf563e540 going to sleep for 11 seconds 00000100:00100000:1.0:1780809600.841384:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc556d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338762112:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809600.841395:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809600.841479:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809600.841514:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335054208 00000100:00100000:1.0:1780809600.841519:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335054208 00010000:00010000:1.0:1780809600.841533:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 72 pid: 77628 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809600.841558:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 616 00000100:00100000:1.0:1780809600.841567:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf5456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2393:x1867312335054208:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809600.841576:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809600.841583:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 72 pid: 77628 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.841623:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 72 pid: 77628 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.841638:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f476b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872599 expref: 72 pid: 77628 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.841653:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809600.841658:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.841667:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.841674:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.841691:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809600.841717:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf5456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2393:x1867312335054208:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 150us (236us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809600.841720:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809600.841731:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 616 00010000:00010000:2.0:1780809600.841737:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809600.841752:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809600.841869:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 72 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.841887:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 71 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.841895:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.841906:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809600.841909:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64a00, rc 0) 00000100:00100000:2.0:1780809600.841949:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:143249:x1867312335054080:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1445us (1525us total) trans 55834578813 rc 0/0 00000100:00100000:2.0:1780809600.841957:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7628 00000100:00100000:3.0:1780809600.883767:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780809600.883792:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338762240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780809600.883891:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809600.883936:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338762240 00000100:00100000:2.0:1780809600.883947:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338762240 00000100:00100000:2.0:1780809600.884001:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1780809600.884010:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338762240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780809600.884038:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809600.884105:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338762240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809600.884115:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1780809600.884144:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338762240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780809600.923266:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809600.923346:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335054464 00000100:00100000:2.0:1780809600.923361:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335054464 00000100:00100000:2.0:1780809600.923437:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7629 00000100:00100000:2.0:1780809600.923453:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:143256:x1867312335054464:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809600.923484:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809600.923510:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725a7 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.923676:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.923696:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.923710:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.923745:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.923755:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.923763:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924256:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f479c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924268:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f479c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924277:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f479c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809600.924290:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809600.924403:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924412:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924421:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924428:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809600.924433:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924454:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924469:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809600.924473:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809600.924479:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924486:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f478e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924520:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924528:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924535:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924541:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809600.924544:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924551:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924558:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:2.0:1780809600.924561:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809600.924565:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924582:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4795 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924692:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a7 expref: 74 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924712:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f479c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a7 expref: 73 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809600.924721:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809600.924724:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809600.924727:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:2.0:1780809600.924799:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:143256:x1867312335054464:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1350us (1543us total) trans 55834578814 rc 0/0 00000100:00100000:2.0:1780809600.924809:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7629 00000100:00100000:0.0:1780809600.925931:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809600.925966:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809600.925980:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335054848 00000100:00100000:3.0:1780809600.925986:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335054848 00000100:00100000:3.0:1780809600.926026:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1893 00000100:00100000:1.0:1780809600.926026:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335054592 00000100:00100000:1.0:1780809600.926033:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335054592 00000100:00100000:3.0:1780809600.926039:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:143256:x1867312335054848:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809600.926075:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2210 00000100:00100000:1.0:1780809600.926084:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2394:x1867312335054592:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809600.926094:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809600.926108:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f479c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a7 expref: 74 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809600.926132:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809600.926136:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809600.926168:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:2394:x1867312335054592:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809600.926174:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2210 00000100:00100000:3.0:1780809600.926198:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:143256:x1867312335054848:12345-192.168.203.33@tcp:35:dd.0 Request processed in 159us (263us total) trans 55834578815 rc 0/0 00000100:00100000:3.0:1780809600.926208:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1893 00000100:00100000:3.0:1780809601.126509:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.126570:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335055104 00000100:00100000:0.0:1780809601.126583:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335055104 00000100:00100000:0.0:1780809601.126669:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1894 00000100:00100000:0.0:1780809601.126679:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:143243:x1867312335055104:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809601.126995:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:143243:x1867312335055104:12345-192.168.203.33@tcp:35:dd.0 Request processed in 317us (497us total) trans 55834578816 rc 0/0 00000100:00100000:0.0:1780809601.127002:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1894 00000100:00100000:0.0:1780809601.177890:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809601.177958:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335055360 00000100:00100000:2.0:1780809601.177972:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335055360 00000100:00100000:2.0:1780809601.178035:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7630 00000100:00100000:2.0:1780809601.178044:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+74:143264:x1867312335055360:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809601.178071:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809601.178095:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f47aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725ae expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178175:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178191:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178218:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178232:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178241:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178249:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178691:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f47bf lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178700:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f47bf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178706:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f47bf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809601.178715:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809601.178809:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178815:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178821:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178825:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.178834:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178842:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178868:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809601.178871:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.178876:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178881:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178908:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178912:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178917:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178920:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.178922:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178926:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178930:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:2.0:1780809601.178931:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.178941:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178945:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.178998:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f47aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ae expref: 77 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.179009:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f47bf lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ae expref: 76 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.179015:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809601.179017:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809601.179019:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f800, rc 0) 00000100:00100000:2.0:1780809601.179079:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:143264:x1867312335055360:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1037us (1201us total) trans 55834578817 rc 0/0 00000100:00100000:2.0:1780809601.179084:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7630 00000100:00100000:2.0:1780809601.180419:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.180493:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335055488 00000100:00100000:0.0:1780809601.180507:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335055488 00000100:00100000:0.0:1780809601.180632:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2211 00000100:00100000:0.0:1780809601.180649:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+76:2393:x1867312335055488:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809601.180667:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809601.180692:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f47bf lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ae expref: 76 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.180728:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809601.180734:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809601.180803:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:2393:x1867312335055488:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 159us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809601.180815:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2211 00000100:00100000:3.0:1780809601.356639:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809601.356715:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335055744 00000100:00100000:2.0:1780809601.356727:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335055744 00000100:00100000:2.0:1780809601.356784:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7631 00000100:00100000:2.0:1780809601.356796:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+75:143277:x1867312335055744:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809601.356822:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809601.356859:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f47cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725b5 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.356925:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.356952:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.356961:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.356971:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.356976:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.356981:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357312:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f47e2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357319:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f47e2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357325:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f47e2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809601.357332:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809601.357404:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357409:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357414:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357424:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.357427:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357432:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357441:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809601.357443:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.357447:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357451:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357473:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357477:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357481:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357484:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.357486:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357489:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357500:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:2.0:1780809601.357502:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.357504:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357508:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357547:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f47cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725b5 expref: 78 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357557:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f47e2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725b5 expref: 77 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.357562:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809601.357563:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809601.357565:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:2.0:1780809601.357662:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:143277:x1867312335055744:12345-192.168.203.33@tcp:101:dd.0 Request processed in 870us (1035us total) trans 55834578818 rc 0/0 00000100:00100000:2.0:1780809601.357668:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7631 00000100:00100000:3.0:1780809601.359215:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809601.359256:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809601.359298:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335055872 00000100:00100000:1.0:1780809601.359310:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335055872 00000100:00100000:0.0:1780809601.359320:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335056128 00000100:00100000:0.0:1780809601.359330:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335056128 00000100:00100000:0.0:1780809601.359396:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1895 00000100:00100000:1.0:1780809601.359403:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2212 00000100:00100000:0.0:1780809601.359409:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:143277:x1867312335056128:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809601.359424:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc40c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:2393:x1867312335055872:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809601.359445:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809601.359473:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f47e2 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725b5 expref: 78 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.359509:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809601.359515:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809601.359541:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:143277:x1867312335056128:12345-192.168.203.33@tcp:35:dd.0 Request processed in 135us (283us total) trans 55834578819 rc 0/0 00000100:00100000:0.0:1780809601.359548:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1895 00000100:00100000:1.0:1780809601.359566:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc40c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:2393:x1867312335055872:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 146us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809601.359580:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2212 00000100:00100000:3.0:1780809601.511557:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.512337:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335056384 00000100:00100000:0.0:1780809601.512367:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335056384 00000100:00100000:0.0:1780809601.512431:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1896 00000100:00100000:0.0:1780809601.512445:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+77:143264:x1867312335056384:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809601.512713:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:143264:x1867312335056384:12345-192.168.203.33@tcp:35:dd.0 Request processed in 271us (1169us total) trans 55834578820 rc 0/0 00000100:00100000:0.0:1780809601.512723:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1896 00000100:00100000:3.0:1780809601.533941:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809601.533988:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809601.534019:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809601.534026:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335056512 00000100:00100000:2.0:1780809601.534038:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335056512 00000100:00100000:0.0:1780809601.534054:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335056640 00000100:00100000:0.0:1780809601.534066:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335056640 00000100:00100000:3.0:1780809601.534067:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809601.534110:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335056768 00000100:00100000:1.0:1780809601.534110:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335056896 00000100:00100000:2.0:1780809601.534113:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 391 00000100:00100000:3.0:1780809601.534117:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335056768 00000100:00100000:1.0:1780809601.534118:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335056896 00000100:00100000:2.0:1780809601.534131:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2391:x1867312335056512:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:0.0:1780809601.534139:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780809601.534144:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780809601.534147:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780809601.534183:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 669 00000100:00100000:1.0:1780809601.534183:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1111 00000100:00100000:3.0:1780809601.534197:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335056768:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809601.534197:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335056896:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809601.534199:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1112 00000100:00100000:0.0:1780809601.534227:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2392:x1867312335056640:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809601.534230:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2391:x1867312335056512:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809601.534244:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 391 00000100:00100000:3.0:1780809601.534269:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335056768:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809601.534269:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335056896:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809601.534270:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2392:x1867312335056640:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 57us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809601.534285:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1112 00000100:00100000:3.0:1780809601.534291:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 669 00000100:00100000:1.0:1780809601.534302:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1111 00000100:00100000:3.0:1780809601.534394:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809601.534438:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335057024 00000100:00100000:1.0:1780809601.534443:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335057024 00000100:00100000:1.0:1780809601.534498:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1113 00000100:00080000:2.0:1780809601.534507:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780809601.534509:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335057024:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809601.534554:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335057024:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809601.534562:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1113 00000100:00100000:3.0:1780809601.570644:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809601.570719:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335057152 00000100:00100000:2.0:1780809601.570731:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335057152 00000100:00100000:2.0:1780809601.570801:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7632 00000100:00100000:2.0:1780809601.570816:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+78:143285:x1867312335057152:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809601.570863:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809601.570891:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f47f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725bc expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.570975:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.570996:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571010:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571028:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571038:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571046:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571492:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571508:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 79 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571533:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571578:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 79 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.571634:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 79 pid: 77627 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809601.571649:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338762368:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809601.571732:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc6101e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780809601.572718:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338762368:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809601.572739:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809601.572798:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.572861:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335057408 00000100:00100000:0.0:1780809601.572867:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335057408 00000100:00100000:0.0:1780809601.572950:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1897 00000100:00100000:0.0:1780809601.572962:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:89646:x1867312335057408:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809601.573160:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:89646:x1867312335057408:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 200us (360us total) trans 55834578821 rc 0/0 00000100:00100000:0.0:1780809601.573168:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1897 00000100:00100000:3.0:1780809601.573963:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809601.574011:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335057536 00000100:00100000:1.0:1780809601.574017:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335057536 00010000:00010000:1.0:1780809601.574040:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 81 pid: 77627 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809601.574068:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 617 00000100:00100000:1.0:1780809601.574077:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:2393:x1867312335057536:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809601.574094:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809601.574103:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 81 pid: 77627 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.574118:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 81 pid: 77627 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.574137:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4779 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725a0 expref: 81 pid: 77627 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.574150:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809601.574161:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.574167:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.574172:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.574190:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809601.574220:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:2393:x1867312335057536:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 142us (255us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809601.574222:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574235:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809601.574236:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 617 00000004:00200000:2.0:1780809601.574267:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809601.574272:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809601.574284:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574295:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574313:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574319:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574324:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574329:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.574333:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574339:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574346:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809601.574348:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.574351:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574355:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f47f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574379:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574383:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574387:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574397:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.574399:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574403:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574408:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:2.0:1780809601.574409:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.574411:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574414:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f47fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574452:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f47f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 80 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574462:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 79 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.574468:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809601.574470:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809601.574471:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e400, rc 0) 00000100:00100000:2.0:1780809601.574498:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:143285:x1867312335057152:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3688us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809601.574503:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7632 00000100:00100000:3.0:1780809601.576501:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809601.576542:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335057792 00000100:00100000:1.0:1780809601.576547:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335057792 00000100:00100000:1.0:1780809601.576576:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7633 00000100:00100000:1.0:1780809601.576582:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+79:143285:x1867312335057792:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809601.576615:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809601.576628:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f480c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725c3 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.576697:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.576711:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 80 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.576717:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.576745:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 80 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.576753:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 80 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809601.576761:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc556d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338762496:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809601.576800:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf563e540 going to sleep for 11 seconds 00000100:00100000:2.0:1780809601.577573:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc556d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338762496:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809601.577613:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809601.577665:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.577702:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335057920 00000100:00100000:0.0:1780809601.577707:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335057920 00010000:00010000:0.0:1780809601.577771:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 81 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809601.577815:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 618 00000100:00100000:0.0:1780809601.577824:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cade5525850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:2394:x1867312335057920:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809601.577835:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809601.577871:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 81 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.577880:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 81 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.577892:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4805 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725bc expref: 81 pid: 79214 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.577904:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809601.577907:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.577913:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.577918:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.577932:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809601.577952:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809601.577959:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cade5525850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:2394:x1867312335057920:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 135us (292us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809601.577961:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809601.577970:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 618 00000004:00200000:2.0:1780809601.577978:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809601.578057:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f480c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 81 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.578070:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 80 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.578076:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809601.578078:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809601.578080:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64c00, rc 0) 00000100:00100000:2.0:1780809601.578125:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:143285:x1867312335057792:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1537us (1619us total) trans 55834578822 rc 0/0 00000100:00100000:2.0:1780809601.578134:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7633 00010000:00010000:1.0:1780809601.587755:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809601.638130:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809601.638229:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335058176 00000100:00100000:2.0:1780809601.638242:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335058176 00000100:00100000:2.0:1780809601.638306:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7634 00000100:00100000:2.0:1780809601.638315:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+80:143292:x1867312335058176:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809601.638343:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809601.638366:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725ca expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638466:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638482:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638493:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638505:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638512:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638520:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638974:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4836 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638983:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4836 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.638989:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4836 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809601.638997:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809601.639093:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639119:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639126:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639131:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.639135:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639142:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639156:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809601.639159:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.639166:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639173:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639208:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639214:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639219:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639222:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.639230:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639235:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639241:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:2.0:1780809601.639243:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.639245:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639249:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f482f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639303:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ca expref: 83 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639315:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4836 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ca expref: 82 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.639321:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809601.639322:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809601.639324:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:2.0:1780809601.639387:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:143292:x1867312335058176:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1074us (1285us total) trans 55834578823 rc 0/0 00000100:00100000:2.0:1780809601.639393:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7634 00000100:00100000:1.0:1780809601.640704:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809601.640741:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335058304 00000100:00100000:2.0:1780809601.640746:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335058304 00000100:00100000:2.0:1780809601.640780:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2213 00000100:00100000:2.0:1780809601.640786:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc556d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+82:2393:x1867312335058304:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809601.640802:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809601.640814:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4836 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ca expref: 82 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.640826:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809601.640829:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809601.640868:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc556d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:2393:x1867312335058304:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 82us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809601.640874:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2213 00000100:00100000:3.0:1780809601.716113:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.716176:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335058560 00000100:00100000:0.0:1780809601.716200:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335058560 00000100:00100000:0.0:1780809601.716260:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7635 00000100:00100000:0.0:1780809601.716269:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+81:143298:x1867312335058560:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809601.716304:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809601.716327:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725d1 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716407:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716422:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716433:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716444:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716450:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716454:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716887:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4859 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716896:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4859 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.716901:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4859 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809601.716916:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809601.717012:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717019:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717024:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717028:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809601.717033:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717040:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717050:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809601.717052:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809601.717056:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717061:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f484b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717080:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717084:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717098:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717102:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809601.717104:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717108:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717113:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809601.717114:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809601.717117:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717122:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4852 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717173:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725d1 expref: 84 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717190:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4859 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725d1 expref: 83 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.717198:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809601.717201:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809601.717204:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce800, rc 0) 00000100:00100000:0.0:1780809601.717277:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:143298:x1867312335058560:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1008us (1174us total) trans 55834578824 rc 0/0 00000100:00100000:0.0:1780809601.717295:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7635 00000100:00100000:3.0:1780809601.718487:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809601.718520:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809601.718534:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335058688 00000100:00100000:1.0:1780809601.718540:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335058688 00000100:00100000:0.0:1780809601.718555:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335058944 00000100:00100000:0.0:1780809601.718560:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335058944 00000100:00100000:1.0:1780809601.718613:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2214 00000100:00100000:0.0:1780809601.718619:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1898 00000100:00100000:1.0:1780809601.718631:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:2394:x1867312335058688:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1780809601.718637:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+84:143298:x1867312335058944:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:1.0:1780809601.718648:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809601.718667:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4859 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725d1 expref: 84 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809601.718681:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809601.718684:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809601.718715:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:2394:x1867312335058688:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809601.718724:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2214 00000100:00100000:0.0:1780809601.718773:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+83:143298:x1867312335058944:12345-192.168.203.33@tcp:35:dd.0 Request processed in 144us (253us total) trans 55834578825 rc 0/0 00000100:00100000:0.0:1780809601.718780:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1898 00000001:00080000:2.0:1780809601.916297:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578825 is committed 00000100:00100000:1.0:1780809601.971017:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809601.971071:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.971074:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335059456 00000100:00100000:0.0:1780809601.971089:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335059456 00000100:00100000:2.0:1780809601.971138:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335059200 00000100:00100000:0.0:1780809601.971152:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1899 00000100:00100000:2.0:1780809601.971153:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335059200 00000100:00100000:0.0:1780809601.971165:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:143292:x1867312335059456:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809601.971209:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7636 00000100:00100000:2.0:1780809601.971219:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:143305:x1867312335059200:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809601.971230:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809601.971252:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725d8 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971331:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971351:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971366:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971381:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971394:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971400:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809601.971505:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:143292:x1867312335059456:12345-192.168.203.33@tcp:35:dd.0 Request processed in 342us (499us total) trans 55834578826 rc 0/0 00000100:00100000:0.0:1780809601.971512:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1899 00010000:00010000:2.0:1780809601.971858:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f487c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971867:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f487c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971873:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f487c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809601.971883:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809601.971936:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971943:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971949:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971953:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.971957:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971963:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971982:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809601.971985:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.971989:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.971994:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f486e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972019:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972022:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972026:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972030:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809601.972033:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972036:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972040:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:2.0:1780809601.972042:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809601.972043:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972047:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4875 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972099:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725d8 expref: 21 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972113:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f487c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725d8 expref: 20 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809601.972123:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809601.972125:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809601.972129:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f200, rc 0) 00000100:00100000:2.0:1780809601.972167:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:143305:x1867312335059200:12345-192.168.203.33@tcp:101:dd.0 Request processed in 950us (1094us total) trans 55834578827 rc 0/0 00000100:00100000:2.0:1780809601.972173:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7636 00000100:00100000:1.0:1780809601.973199:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809601.973253:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335059584 00000100:00100000:0.0:1780809601.973258:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335059584 00000100:00100000:0.0:1780809601.973294:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2215 00000100:00100000:0.0:1780809601.973301:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:2393:x1867312335059584:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809601.973310:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809601.973323:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f487c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725d8 expref: 20 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809601.973338:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809601.973347:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809601.973374:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:2393:x1867312335059584:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809601.973380:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2215 00000100:00100000:3.0:1780809602.207910:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809602.207969:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335059712 00000100:00100000:1.0:1780809602.207981:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335059712 00000100:00080000:2.0:1780809602.208033:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780809602.208050:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7637 00000100:00100000:1.0:1780809602.208060:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+19:143312:x1867312335059712:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809602.208082:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809602.208099:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f488a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725df expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208151:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208163:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208172:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208181:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208186:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208191:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208501:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208510:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 20 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208525:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208564:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 20 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.208574:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 20 pid: 80225 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809602.208585:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338762624:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809602.208688:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae00e4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1780809602.209563:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338762624:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809602.209582:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809602.209685:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809602.209747:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335059968 00000100:00100000:0.0:1780809602.209753:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335059968 00000100:00100000:0.0:1780809602.209785:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1900 00000100:00100000:0.0:1780809602.209794:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:89646:x1867312335059968:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809602.209961:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:89646:x1867312335059968:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 168us (276us total) trans 55834578828 rc 0/0 00000100:00100000:0.0:1780809602.209967:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1900 00000100:00100000:3.0:1780809602.210657:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809602.210697:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335060096 00000100:00100000:2.0:1780809602.210702:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335060096 00010000:00010000:2.0:1780809602.210721:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 22 pid: 80225 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.210746:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 619 00000100:00100000:2.0:1780809602.210752:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:2394:x1867312335060096:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809602.210760:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809602.210765:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 22 pid: 80225 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.210775:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 22 pid: 80225 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.210797:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4813 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725c3 expref: 22 pid: 80225 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.210807:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809602.210811:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.210816:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.210820:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.210849:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809602.210874:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.210879:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:2394:x1867312335060096:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 126us (222us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809602.210885:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.210891:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 619 00000004:00200000:1.0:1780809602.210916:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809602.210920:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809602.210930:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.210940:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.210970:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.210978:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.210987:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.210994:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809602.210998:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211005:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211013:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809602.211016:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809602.211019:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211023:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4891 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211034:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211042:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211049:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211062:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809602.211067:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211074:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211085:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f500) 00010000:00010000:1.0:1780809602.211087:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809602.211090:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211094:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f4898 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211120:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f488a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 21 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211128:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 20 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.211133:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809602.211135:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809602.211137:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64e00, rc 0) 00000100:00100000:1.0:1780809602.211167:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:143312:x1867312335059712:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3110us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809602.211172:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7637 00000100:00100000:3.0:1780809602.212770:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809602.212799:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335060352 00000100:00100000:2.0:1780809602.212804:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335060352 00000100:00100000:2.0:1780809602.212832:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7638 00000100:00100000:2.0:1780809602.212853:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:143312:x1867312335060352:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809602.212863:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809602.212871:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f48a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725e6 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.212914:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.212932:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 21 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.212945:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.212960:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 21 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.212969:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 21 pid: 77627 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.212976:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338762752:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809602.213009:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc57d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780809602.213643:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338762752:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809602.213659:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809602.213878:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809602.213918:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335060480 00000100:00100000:1.0:1780809602.213931:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335060480 00010000:00010000:1.0:1780809602.213959:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 22 pid: 77627 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809602.213988:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 620 00000100:00100000:1.0:1780809602.213996:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:2393:x1867312335060480:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780809602.214005:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809602.214010:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 22 pid: 77627 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.214018:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 22 pid: 77627 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.214028:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f489f lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725df expref: 22 pid: 77627 timeout: 1964 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.214036:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809602.214039:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.214044:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.214049:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.214062:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780809602.214082:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809602.214085:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:2393:x1867312335060480:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 90us (207us total) trans 0 rc 0/0 00010000:00010000:2.0:1780809602.214097:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809602.214114:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 620 00000004:00200000:2.0:1780809602.214117:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809602.214196:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f48a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 22 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.214237:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 21 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.214245:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809602.214248:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1780809602.214251:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ec00, rc 0) 00000100:00100000:2.0:1780809602.214284:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:143312:x1867312335060352:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1444us (1512us total) trans 55834578829 rc 0/0 00000100:00100000:2.0:1780809602.214294:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7638 00000100:00100000:3.0:1780809602.285296:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809602.285352:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335060736 00000100:00100000:0.0:1780809602.285363:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335060736 00000100:00100000:0.0:1780809602.285444:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1901 00000100:00100000:0.0:1780809602.285455:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:143305:x1867312335060736:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809602.285704:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:143305:x1867312335060736:12345-192.168.203.33@tcp:35:dd.0 Request processed in 251us (415us total) trans 55834578830 rc 0/0 00000100:00100000:0.0:1780809602.285711:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1901 00000100:00100000:0.0:1780809602.397869:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809602.397919:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335060992 00000100:00100000:1.0:1780809602.397930:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335060992 00000100:00100000:1.0:1780809602.397980:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7639 00000100:00100000:1.0:1780809602.397988:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:143327:x1867312335060992:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809602.398009:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809602.398026:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f48bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725ed expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398087:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398099:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398107:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398128:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398141:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398149:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398482:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f48d0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398499:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f48d0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398505:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f48d0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809602.398513:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809602.398585:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398609:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398613:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398617:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809602.398620:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398626:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398634:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809602.398636:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809602.398639:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398643:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f48c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398660:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398664:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398668:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398671:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809602.398673:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398677:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398681:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f500) 00010000:00010000:1.0:1780809602.398683:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809602.398685:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398688:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f48c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398722:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f48bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ed expref: 25 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398730:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f48d0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ed expref: 24 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.398743:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809602.398745:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809602.398747:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:1.0:1780809602.398793:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:143327:x1867312335060992:12345-192.168.203.33@tcp:101:dd.0 Request processed in 806us (932us total) trans 55834578831 rc 0/0 00000100:00100000:1.0:1780809602.398798:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7639 00000100:00100000:3.0:1780809602.400116:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809602.400163:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335061120 00000100:00100000:0.0:1780809602.400167:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335061120 00000100:00100000:0.0:1780809602.400198:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2216 00000100:00100000:0.0:1780809602.400204:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:2394:x1867312335061120:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809602.400212:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809602.400241:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f48d0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725ed expref: 24 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.400261:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809602.400264:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809602.400309:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:2394:x1867312335061120:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 104us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809602.400317:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2216 00000100:00100000:3.0:1780809602.517905:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809602.517974:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335061376 00000100:00100000:2.0:1780809602.517984:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335061376 00000100:00100000:2.0:1780809602.518040:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7640 00000100:00100000:2.0:1780809602.518053:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:143333:x1867312335061376:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809602.518078:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809602.518099:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f48de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725f4 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518183:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518198:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518210:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518225:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518246:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518254:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518639:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f48f3 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518651:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f48f3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518659:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f48f3 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809602.518670:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809602.518759:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518766:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518771:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518774:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809602.518778:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518783:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518808:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809602.518811:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809602.518814:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518819:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f48e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518849:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518854:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518858:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518861:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809602.518863:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518867:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518871:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:2.0:1780809602.518873:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809602.518876:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518882:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f48ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518946:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f48de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725f4 expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518960:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f48f3 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725f4 expref: 25 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.518966:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809602.518967:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809602.518969:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:2.0:1780809602.519017:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:143333:x1867312335061376:12345-192.168.203.33@tcp:101:dd.0 Request processed in 969us (1122us total) trans 55834578832 rc 0/0 00000100:00100000:2.0:1780809602.519022:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7640 00000100:00100000:1.0:1780809602.521045:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809602.521075:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809602.521093:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335061504 00000100:00100000:2.0:1780809602.521099:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335061504 00000100:00100000:0.0:1780809602.521118:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335061760 00000100:00100000:0.0:1780809602.521125:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335061760 00000100:00100000:2.0:1780809602.521138:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2217 00000100:00100000:2.0:1780809602.521147:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadeccf2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:2393:x1867312335061504:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809602.521156:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1780809602.521166:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1902 00010000:00010000:2.0:1780809602.521172:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f48f3 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725f4 expref: 26 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809602.521179:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:143333:x1867312335061760:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809602.521194:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809602.521199:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809602.521229:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadeccf2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:2393:x1867312335061504:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809602.521235:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2217 00000100:00100000:0.0:1780809602.521307:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:143333:x1867312335061760:12345-192.168.203.33@tcp:35:dd.0 Request processed in 134us (230us total) trans 55834578833 rc 0/0 00000100:00100000:0.0:1780809602.521314:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1902 00010000:00010000:1.0:1780809602.611770:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809602.718393:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809602.718440:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335062016 00000100:00100000:0.0:1780809602.718449:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335062016 00000100:00100000:0.0:1780809602.718495:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1903 00000100:00100000:0.0:1780809602.718503:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:143327:x1867312335062016:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809602.718744:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:143327:x1867312335062016:12345-192.168.203.33@tcp:35:dd.0 Request processed in 240us (357us total) trans 55834578834 rc 0/0 00000100:00100000:0.0:1780809602.718753:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1903 00000100:00100000:3.0:1780809602.879986:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809602.880039:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335062272 00000100:00100000:0.0:1780809602.880050:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335062272 00000100:00100000:0.0:1780809602.880103:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7641 00000100:00100000:0.0:1780809602.880110:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+26:143341:x1867312335062272:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809602.880131:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809602.880159:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468725fb expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880219:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880231:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880241:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880250:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880255:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880259:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880577:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4916 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880585:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4916 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880614:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4916 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809602.880622:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809602.880693:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880707:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880712:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880716:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809602.880719:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880725:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880734:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809602.880736:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809602.880740:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880744:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880758:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880762:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880766:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880769:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809602.880775:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880779:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880784:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809602.880786:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809602.880787:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880791:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f490f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880821:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725fb expref: 29 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880845:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4916 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725fb expref: 28 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.880851:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809602.880852:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809602.880854:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cec00, rc 0) 00000100:00100000:0.0:1780809602.880905:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:143341:x1867312335062272:12345-192.168.203.33@tcp:101:dd.0 Request processed in 794us (929us total) trans 55834578835 rc 0/0 00000100:00100000:0.0:1780809602.880910:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7641 00000100:00100000:1.0:1780809602.882343:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809602.882393:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335062400 00000100:00100000:2.0:1780809602.882398:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335062400 00000100:00100000:2.0:1780809602.882434:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2218 00000100:00100000:2.0:1780809602.882441:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:2394:x1867312335062400:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809602.882453:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809602.882469:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4916 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725fb expref: 28 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.882484:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809602.882487:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809602.882519:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:2394:x1867312335062400:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809602.882528:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2218 00000100:00100000:3.0:1780809602.951201:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809602.951268:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335062528 00000100:00100000:2.0:1780809602.951278:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335062528 00000100:00100000:2.0:1780809602.951332:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7642 00000100:00100000:2.0:1780809602.951343:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+27:143347:x1867312335062528:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809602.951368:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809602.951389:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872602 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951452:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951468:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951480:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951509:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951529:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951537:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951943:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951953:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 28 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951959:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951985:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 28 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.951995:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 28 pid: 79214 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.952006:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338762880:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809602.952069:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf6ec2840 going to sleep for 11 seconds 00000100:00100000:2.0:1780809602.952940:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338762880:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809602.952959:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809602.953188:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809602.953265:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335062784 00000100:00100000:0.0:1780809602.953273:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335062784 00000100:00100000:0.0:1780809602.953310:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1904 00000100:00100000:0.0:1780809602.953321:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:89646:x1867312335062784:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809602.953486:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:89646:x1867312335062784:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 168us (298us total) trans 55834578836 rc 0/0 00000100:00100000:0.0:1780809602.953493:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1904 00000100:00100000:3.0:1780809602.954353:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809602.954395:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335062912 00000100:00100000:0.0:1780809602.954400:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335062912 00010000:00010000:0.0:1780809602.954417:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 30 pid: 79214 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809602.954440:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 621 00000100:00100000:0.0:1780809602.954446:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee57a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2393:x1867312335062912:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780809602.954455:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780809602.954460:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 30 pid: 79214 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.954470:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 30 pid: 79214 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.954484:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f48ad lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468725e6 expref: 30 pid: 79214 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.954507:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809602.954510:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.954516:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.954529:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809602.954547:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809602.954571:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee57a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2393:x1867312335062912:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 125us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809602.954578:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 621 00010000:00010000:2.0:1780809602.954580:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954615:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809602.954640:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:2.0:1780809602.954643:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780809602.954658:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954671:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954681:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954689:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954697:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954703:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809602.954708:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954716:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954727:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809602.954737:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809602.954743:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954750:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f492b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954771:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954779:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954786:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954792:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809602.954796:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954803:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954813:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:2.0:1780809602.954816:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809602.954819:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954826:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954878:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 29 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954904:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 28 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.954909:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809602.954911:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780809602.954913:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:2.0:1780809602.954940:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:143347:x1867312335062528:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3600us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809602.954945:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7642 00000100:00100000:3.0:1780809602.956708:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809602.956753:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335063168 00000100:00100000:1.0:1780809602.956759:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335063168 00000100:00100000:1.0:1780809602.956790:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7643 00000100:00100000:1.0:1780809602.956796:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+28:143347:x1867312335063168:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809602.956808:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809602.956818:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872609 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.956879:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.956888:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 29 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.956894:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.956920:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 29 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.956936:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 29 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809602.956945:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef0a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338763008:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809602.956983:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397000 going to sleep for 11 seconds 00000100:00100000:2.0:1780809602.957645:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef0a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338763008:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809602.957657:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809602.957917:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809602.957953:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335063296 00000100:00100000:2.0:1780809602.957959:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335063296 00010000:00010000:2.0:1780809602.957978:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 30 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.958006:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 622 00000100:00100000:2.0:1780809602.958016:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee57b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+30:2394:x1867312335063296:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809602.958027:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809602.958033:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 30 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.958045:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 30 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.958066:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4939 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872602 expref: 30 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.958082:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809602.958087:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.958095:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.958102:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809602.958122:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809602.958150:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.958155:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee57b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:2394:x1867312335063296:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (236us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809602.958168:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809602.958174:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 622 00000004:00200000:1.0:1780809602.958187:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809602.958281:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 30 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.958297:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 29 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809602.958306:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809602.958310:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809602.958313:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65600, rc 0) 00000100:00100000:1.0:1780809602.958351:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:143347:x1867312335063168:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1550us (1640us total) trans 55834578837 rc 0/0 00000100:00100000:1.0:1780809602.958361:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7643 00000100:00100000:3.0:1780809603.147524:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.147620:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335063552 00000100:00100000:2.0:1780809603.147631:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335063552 00000100:00100000:2.0:1780809603.147693:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7644 00000100:00100000:2.0:1780809603.147703:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+29:143354:x1867312335063552:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809603.147726:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809603.147747:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872610 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.147821:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.147869:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.147881:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.147896:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.147904:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.147911:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148279:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f496a lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148291:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f496a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148299:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f496a lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809603.148309:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809603.148397:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148406:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148413:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148426:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809603.148430:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148438:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148451:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809603.148454:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809603.148460:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148466:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f495c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148491:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148498:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148505:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148510:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809603.148513:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148520:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148538:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:2.0:1780809603.148541:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809603.148544:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148550:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4963 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148627:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872610 expref: 32 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148658:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f496a lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872610 expref: 31 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.148667:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.148670:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809603.148673:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f400, rc 0) 00000100:00100000:2.0:1780809603.148730:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:143354:x1867312335063552:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1028us (1212us total) trans 55834578838 rc 0/0 00000100:00100000:2.0:1780809603.148738:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7644 00000100:00100000:0.0:1780809603.150036:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.150070:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335063680 00000100:00100000:2.0:1780809603.150076:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335063680 00000100:00100000:0.0:1780809603.150097:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.150116:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2219 00000100:00100000:2.0:1780809603.150126:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2393:x1867312335063680:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809603.150137:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809603.150152:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f496a lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872610 expref: 31 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809603.150156:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335063936 00000100:00100000:1.0:1780809603.150164:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335063936 00010000:00010000:2.0:1780809603.150189:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.150194:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780809603.150213:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1905 00000100:00100000:1.0:1780809603.150223:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:143354:x1867312335063936:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809603.150230:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:2393:x1867312335063680:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 103us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.150239:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2219 00000100:00100000:1.0:1780809603.150330:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:143354:x1867312335063936:12345-192.168.203.33@tcp:35:dd.0 Request processed in 109us (234us total) trans 55834578839 rc 0/0 00000100:00100000:1.0:1780809603.150337:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1905 00000100:00100000:0.0:1780809603.225377:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809603.225449:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335064192 00000100:00100000:3.0:1780809603.225460:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335064192 00000100:00100000:3.0:1780809603.225516:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1906 00000100:00100000:3.0:1780809603.225528:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc84ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+31:143341:x1867312335064192:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809603.225776:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc84ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:143341:x1867312335064192:12345-192.168.203.33@tcp:35:dd.0 Request processed in 249us (404us total) trans 55834578840 rc 0/0 00000100:00100000:3.0:1780809603.225786:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1906 00000100:00100000:3.0:1780809603.289337:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809603.289430:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335064320 00000100:00100000:1.0:1780809603.289442:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335064320 00000100:00100000:1.0:1780809603.289505:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7645 00000100:00100000:1.0:1780809603.289515:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+32:143363:x1867312335064320:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809603.289540:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809603.289564:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872617 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.289661:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.289676:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.289687:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.289700:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.289706:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.289721:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.290065:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.290074:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 33 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.290082:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.290124:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 33 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.290138:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 33 pid: 77627 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809603.290155:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338763136:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809603.290252:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397000 going to sleep for 11 seconds 00000100:00100000:1.0:1780809603.291085:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338763136:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809603.291102:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809603.291229:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809603.291287:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335064576 00000100:00100000:1.0:1780809603.291291:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335064576 00000100:00100000:1.0:1780809603.291324:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1907 00000100:00100000:1.0:1780809603.291331:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:89646:x1867312335064576:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809603.291548:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:89646:x1867312335064576:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 215us (318us total) trans 55834578841 rc 0/0 00000100:00100000:1.0:1780809603.291558:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1907 00000100:00100000:0.0:1780809603.292294:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.292354:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335064704 00000100:00100000:2.0:1780809603.292370:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335064704 00010000:00010000:2.0:1780809603.292417:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 35 pid: 77627 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.292454:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 623 00000100:00100000:2.0:1780809603.292463:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2394:x1867312335064704:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809603.292480:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809603.292486:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 35 pid: 77627 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.292497:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 35 pid: 77627 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.292516:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65600/0x25b625638c8f4947 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872609 expref: 35 pid: 77627 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.292534:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.292540:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.292569:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.292576:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.292639:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809603.292674:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292689:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.292702:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2394:x1867312335064704:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 237us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.292711:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 623 00000004:00200000:3.0:1780809603.292723:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:3.0:1780809603.292731:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809603.292749:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292764:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292776:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292784:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292794:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292801:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809603.292811:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292820:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292844:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809603.292848:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809603.292860:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292869:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65400/0x25b625638c8f497f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292883:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292891:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292898:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292904:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809603.292908:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292915:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292925:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f500) 00010000:00010000:3.0:1780809603.292928:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809603.292931:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292939:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65000/0x25b625638c8f4986 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292972:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65200/0x25b625638c8f4978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 34 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.292998:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 33 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.293007:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809603.293010:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809603.293013:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64600, rc 0) 00000100:00100000:3.0:1780809603.293055:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:143363:x1867312335064320:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3540us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809603.293063:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7645 00000100:00100000:0.0:1780809603.294864:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.294910:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335064960 00000100:00100000:2.0:1780809603.294916:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335064960 00000100:00100000:2.0:1780809603.294947:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7646 00000100:00100000:2.0:1780809603.294955:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+33:143363:x1867312335064960:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809603.294978:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809603.294996:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4994 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687261e expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.295091:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.295106:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 34 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.295117:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.295145:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 34 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.295169:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 34 pid: 80225 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.295185:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338763264:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809603.295245:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc11ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1780809603.296104:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338763264:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809603.296123:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809603.296294:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.296338:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335065088 00000100:00100000:2.0:1780809603.296342:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335065088 00010000:00010000:2.0:1780809603.296362:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 35 pid: 80225 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.296395:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 624 00000100:00100000:2.0:1780809603.296406:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2392:x1867312335065088:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809603.296416:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809603.296423:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 35 pid: 80225 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.296435:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 35 pid: 80225 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.296453:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64600/0x25b625638c8f498d lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872617 expref: 35 pid: 80225 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.296481:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.296486:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.296495:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.296502:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.296522:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809603.296547:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.296558:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:2392:x1867312335065088:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 147us (257us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809603.296566:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.296578:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 624 00000004:00200000:3.0:1780809603.296608:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809603.296727:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4994 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 35 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.296761:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 34 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.296770:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809603.296773:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809603.296776:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:3.0:1780809603.296818:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:143363:x1867312335064960:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1863us (1955us total) trans 55834578842 rc 0/0 00000100:00100000:3.0:1780809603.296850:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7646 00000100:00100000:0.0:1780809603.298400:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809603.298452:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335065344 00000100:00100000:1.0:1780809603.298462:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335065344 00000100:00100000:1.0:1780809603.298506:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7647 00000100:00100000:1.0:1780809603.298518:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+34:143368:x1867312335065344:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809603.298533:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809603.298544:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f49a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872625 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298609:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298619:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298627:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298647:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298652:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298657:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298931:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f49be lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298945:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f49be lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.298951:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f49be lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809603.298957:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809603.299007:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299013:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299017:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299021:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809603.299024:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299029:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299036:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809603.299038:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809603.299041:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299045:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299061:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299066:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299070:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299073:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809603.299075:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299079:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299083:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809603.299085:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809603.299086:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299090:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299113:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65800/0x25b625638c8f49a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872625 expref: 37 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299121:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f49be lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872625 expref: 36 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.299135:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809603.299138:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809603.299141:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65e00, rc 0) 00000100:00100000:1.0:1780809603.299181:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:143368:x1867312335065344:12345-192.168.203.33@tcp:101:dd.0 Request processed in 665us (782us total) trans 55834578843 rc 0/0 00000100:00100000:1.0:1780809603.299189:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7647 00000100:00100000:0.0:1780809603.300903:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.300948:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335065472 00000100:00100000:2.0:1780809603.300954:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335065472 00000100:00100000:2.0:1780809603.300992:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2220 00000100:00100000:2.0:1780809603.300999:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4377450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:2391:x1867312335065472:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809603.301008:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809603.301022:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f49be lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872625 expref: 36 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.301035:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.301038:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809603.301066:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4377450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:2391:x1867312335065472:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.301072:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2220 00000100:00100000:0.0:1780809603.531436:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.531501:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335065600 00000100:00100000:2.0:1780809603.531510:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335065600 00000100:00100000:2.0:1780809603.531564:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7648 00000100:00100000:2.0:1780809603.531571:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+35:143382:x1867312335065600:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809603.531631:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809603.531650:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f49cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687262c expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.531718:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.531733:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.531746:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.531760:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.531765:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.531770:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.532081:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.532090:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 36 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.532106:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.532132:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 36 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.532142:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 36 pid: 77629 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.532153:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338763392:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809603.532226:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf6ec2840 going to sleep for 11 seconds 00000100:00100000:2.0:1780809603.533200:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338763392:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809603.533217:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809603.533318:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809603.533383:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335065856 00000100:00100000:3.0:1780809603.533396:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335065856 00000100:00100000:3.0:1780809603.533455:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1908 00000100:00100000:3.0:1780809603.533469:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:89646:x1867312335065856:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1780809603.533775:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:89646:x1867312335065856:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 309us (456us total) trans 55834578844 rc 0/0 00000100:00100000:3.0:1780809603.533788:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1908 00000100:00100000:0.0:1780809603.534568:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.534611:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335065984 00000100:00100000:2.0:1780809603.534617:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335065984 00010000:00010000:2.0:1780809603.534639:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 38 pid: 77629 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.534665:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 625 00000100:00100000:2.0:1780809603.534675:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2393:x1867312335065984:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809603.534689:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809603.534697:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 38 pid: 77629 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.534725:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 38 pid: 77629 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.534746:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f499b lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687261e expref: 38 pid: 77629 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.534776:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.534781:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.534790:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.534795:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.534816:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809603.534851:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534860:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.534866:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2393:x1867312335065984:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 191us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.534875:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 625 00000004:00200000:0.0:1780809603.534900:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809603.534904:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809603.534920:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534939:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534946:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534951:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534957:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534961:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809603.534965:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534971:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534980:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809603.534982:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809603.534985:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.534990:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f49d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535047:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535053:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535063:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535066:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fe00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809603.535068:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535072:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535078:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54f00) 00010000:00010000:0.0:1780809603.535080:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809603.535083:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535087:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f49da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535139:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f49cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 37 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535153:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 36 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809603.535159:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809603.535160:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809603.535162:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e200, rc 0) 00000100:00100000:0.0:1780809603.535200:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:143382:x1867312335065600:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3629us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809603.535214:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7648 00000100:00100000:0.0:1780809603.536707:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809603.536761:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335066240 00000100:00100000:1.0:1780809603.536768:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335066240 00000100:00100000:1.0:1780809603.536810:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7649 00000100:00100000:1.0:1780809603.536821:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+36:143382:x1867312335066240:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809603.536852:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809603.536867:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872633 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.536945:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.536959:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 37 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.536968:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.536997:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 37 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.537011:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 37 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809603.537035:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338763520:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809603.537098:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadcf397000 going to sleep for 11 seconds 00000100:00100000:2.0:1780809603.537841:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338763520:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809603.537857:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809603.537984:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.538033:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335066368 00000100:00100000:2.0:1780809603.538039:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335066368 00010000:00010000:2.0:1780809603.538057:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 38 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809603.538095:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 626 00000100:00100000:2.0:1780809603.538102:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+38:2392:x1867312335066368:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809603.538110:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809603.538115:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 38 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.538128:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 38 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.538143:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49e1 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687262c expref: 38 pid: 77628 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.538156:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.538159:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.538165:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.538170:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.538187:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809603.538213:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:2392:x1867312335066368:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.538219:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 626 00010000:00010000:1.0:1780809603.538227:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.538239:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809603.538261:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809603.538382:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f49e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 38 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.538398:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 37 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809603.538406:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809603.538409:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809603.538411:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64e00, rc 0) 00000100:00100000:1.0:1780809603.538449:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:143382:x1867312335066240:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1631us (1742us total) trans 55834578845 rc 0/0 00000100:00100000:1.0:1780809603.538458:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7649 00000100:00100000:0.0:1780809603.559115:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.559171:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335066624 00000100:00100000:2.0:1780809603.559192:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335066624 00000100:00100000:2.0:1780809603.559238:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7650 00000100:00100000:2.0:1780809603.559247:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+37:143389:x1867312335066624:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809603.559267:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809603.559284:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687263a expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559348:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559364:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559376:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559394:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559402:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559409:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559813:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4a12 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559822:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4a12 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559844:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4a12 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809603.559859:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809603.559938:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559944:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559949:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559962:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809603.559965:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559971:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559980:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809603.559982:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809603.559986:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.559990:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560011:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560015:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560027:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560030:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809603.560032:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560036:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560041:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:2.0:1780809603.560042:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809603.560044:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560047:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560087:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f49fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687263a expref: 40 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560097:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4a12 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687263a expref: 39 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.560102:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.560103:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809603.560105:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809603.560152:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:143389:x1867312335066624:12345-192.168.203.33@tcp:101:dd.0 Request processed in 907us (1044us total) trans 55834578846 rc 0/0 00000100:00100000:2.0:1780809603.560164:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7650 00000100:00100000:0.0:1780809603.561513:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809603.561566:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.561571:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335066752 00000100:00100000:2.0:1780809603.561579:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335066752 00000100:00100000:1.0:1780809603.561616:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335067008 00000100:00100000:1.0:1780809603.561621:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335067008 00000100:00100000:2.0:1780809603.561648:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2221 00000100:00100000:2.0:1780809603.561660:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:2391:x1867312335066752:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1780809603.561665:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1909 00010000:00010000:2.0:1780809603.561675:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780809603.561681:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:143389:x1867312335067008:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809603.561695:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4a12 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687263a expref: 40 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.561711:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.561714:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809603.561745:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:2391:x1867312335066752:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.561751:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2221 00000100:00100000:1.0:1780809603.561813:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:143389:x1867312335067008:12345-192.168.203.33@tcp:35:dd.0 Request processed in 135us (245us total) trans 55834578847 rc 0/0 00000100:00100000:1.0:1780809603.561841:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1909 00000100:00100000:3.0:1780809603.631803:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809603.631889:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335067264 00000100:00100000:0.0:1780809603.631902:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335067264 00000100:00100000:0.0:1780809603.631970:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1910 00000100:00100000:0.0:1780809603.631980:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+39:143368:x1867312335067264:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809603.632292:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:143368:x1867312335067264:12345-192.168.203.33@tcp:35:dd.0 Request processed in 313us (499us total) trans 55834578848 rc 0/0 00000100:00100000:0.0:1780809603.632299:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1910 00010000:00010000:1.0:1780809603.635768:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809603.955802:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780809603.955848:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc50e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338763648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780809603.955940:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809603.956014:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338763648 00000100:00100000:2.0:1780809603.956026:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338763648 00000100:00100000:2.0:1780809603.956098:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1780809603.956113:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338763648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780809603.956164:0:77632:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1780809603.956222:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338763648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.956229:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1780809603.956283:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc50e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338763648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780809603.959098:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809603.959154:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335067520 00000100:00100000:3.0:1780809603.959163:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335067520 00000100:00100000:3.0:1780809603.959206:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7651 00000100:00100000:3.0:1780809603.959214:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+40:143397:x1867312335067520:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809603.959232:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809603.959255:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4a20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872641 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959332:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959353:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959369:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959382:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959404:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959412:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959764:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4a35 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959773:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4a35 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959779:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4a35 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809603.959789:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809603.959915:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959925:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959934:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959941:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809603.959946:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959964:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.959985:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809603.959988:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809603.959993:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960000:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960017:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960025:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960032:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960038:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809603.960042:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960050:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960059:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809603.960062:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809603.960065:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960072:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960135:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4a20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872641 expref: 43 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960152:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4a35 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872641 expref: 42 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809603.960161:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809603.960163:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809603.960167:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809603.960232:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:143397:x1867312335067520:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1018us (1139us total) trans 55834578849 rc 0/0 00000100:00100000:3.0:1780809603.960242:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7651 00000100:00100000:1.0:1780809603.961401:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809603.961491:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335067648 00000100:00100000:2.0:1780809603.961497:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335067648 00000100:00100000:2.0:1780809603.961538:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2222 00000100:00100000:2.0:1780809603.961545:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+42:2392:x1867312335067648:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809603.961564:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809603.961577:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4a35 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872641 expref: 42 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809603.961618:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809603.961621:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809603.961656:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:2392:x1867312335067648:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809603.961662:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2222 00000100:00100000:0.0:1780809604.013304:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809604.013402:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335067904 00000100:00100000:3.0:1780809604.013420:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335067904 00000100:00080000:2.0:1780809604.013501:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809604.013530:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7652 00000100:00100000:3.0:1780809604.013543:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+41:143403:x1867312335067904:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1780809604.013573:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809604.013630:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872648 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.013718:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.013734:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.013747:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.013789:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.013804:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.013812:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014201:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4a58 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014214:0:77629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4a58 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014224:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4a58 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809604.014236:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809604.014355:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014364:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014373:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014380:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809604.014386:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014409:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014425:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:3.0:1780809604.014429:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809604.014436:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014443:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014459:0:77629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014466:0:77629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014473:0:77629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014480:0:77629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809604.014483:0:77629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014490:0:77629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014498:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:3.0:1780809604.014501:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809604.014505:0:77629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014523:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4a51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014573:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872648 expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014625:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4a58 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872648 expref: 43 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.014634:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809604.014638:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1780809604.014643:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030600, rc 0) 00000100:00100000:3.0:1780809604.014719:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:143403:x1867312335067904:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1178us (1421us total) trans 55834578850 rc 0/0 00000100:00100000:3.0:1780809604.014728:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7652 00000100:00100000:0.0:1780809604.016015:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809604.016068:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.016082:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335068032 00000100:00100000:2.0:1780809604.016091:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335068032 00000100:00100000:1.0:1780809604.016126:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335068288 00000100:00100000:1.0:1780809604.016138:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335068288 00000100:00100000:2.0:1780809604.016149:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2223 00000100:00100000:2.0:1780809604.016166:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacda6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:2394:x1867312335068032:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.016183:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780809604.016206:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1911 00010000:00010000:2.0:1780809604.016212:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4a58 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872648 expref: 44 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809604.016224:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+44:143403:x1867312335068288:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809604.016250:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.016256:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809604.016307:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacda6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:2394:x1867312335068032:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 146us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.016318:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2223 00000100:00100000:1.0:1780809604.016471:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:143403:x1867312335068288:12345-192.168.203.33@tcp:35:dd.0 Request processed in 252us (401us total) trans 55834578851 rc 0/0 00000100:00100000:1.0:1780809604.016478:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1911 00000100:00100000:0.0:1780809604.167425:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809604.167483:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335068544 00000100:00100000:1.0:1780809604.167492:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335068544 00000100:00100000:1.0:1780809604.167543:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7653 00000100:00100000:1.0:1780809604.167550:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+43:143410:x1867312335068544:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809604.167571:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809604.167626:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687264f expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.167702:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.167716:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.167737:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.167747:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.167753:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.167765:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168134:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4a7b lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168142:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4a7b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168147:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4a7b lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809604.168155:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809604.168260:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168269:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168277:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168284:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809604.168294:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168300:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168310:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809604.168312:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809604.168316:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168321:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168330:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168334:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168338:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168341:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809604.168344:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168362:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168375:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809604.168377:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809604.168390:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168397:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4a74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168445:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687264f expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168461:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4a7b lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687264f expref: 45 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.168469:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809604.168472:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809604.168475:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f65a00, rc 0) 00000100:00100000:1.0:1780809604.168534:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:143410:x1867312335068544:12345-192.168.203.33@tcp:101:dd.0 Request processed in 982us (1114us total) trans 55834578852 rc 0/0 00000100:00100000:1.0:1780809604.168543:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7653 00000100:00100000:0.0:1780809604.169624:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809604.169667:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.169704:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335068672 00000100:00100000:2.0:1780809604.169719:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335068672 00000100:00100000:3.0:1780809604.169732:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335068928 00000100:00100000:3.0:1780809604.169738:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335068928 00000100:00100000:3.0:1780809604.169791:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1912 00000100:00100000:3.0:1780809604.169802:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc37d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:143410:x1867312335068928:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809604.169818:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2224 00000100:00100000:2.0:1780809604.169847:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2391:x1867312335068672:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.169877:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809604.169904:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4a7b lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687264f expref: 46 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.169926:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.169932:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809604.170000:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:2391:x1867312335068672:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 158us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809604.170007:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc37d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:143410:x1867312335068928:12345-192.168.203.33@tcp:35:dd.0 Request processed in 204us (335us total) trans 55834578853 rc 0/0 00000100:00100000:2.0:1780809604.170019:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2224 00000100:00100000:3.0:1780809604.170023:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1912 00000100:00100000:0.0:1780809604.273537:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.273626:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335069056 00000100:00100000:2.0:1780809604.273637:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335069056 00000100:00100000:2.0:1780809604.273689:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7654 00000100:00100000:2.0:1780809604.273697:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+45:143417:x1867312335069056:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809604.273720:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809604.273737:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4a89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872656 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.273798:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.273811:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.273820:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.273850:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.273877:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.273882:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.274177:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.274187:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 46 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.274193:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.274219:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 46 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.274230:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 46 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.274241:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338763776:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809604.274309:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc6101e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780809604.275257:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.275280:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338763776:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809604.275303:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809604.275310:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335069312 00000100:00100000:1.0:1780809604.275316:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335069312 00000100:00100000:1.0:1780809604.275353:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1913 00000100:00100000:1.0:1780809604.275365:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:89645:x1867312335069312:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809604.275511:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:89645:x1867312335069312:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 150us (260us total) trans 55834578854 rc 0/0 00000100:00100000:1.0:1780809604.275519:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1913 00000100:00100000:0.0:1780809604.276283:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.276322:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335069440 00000100:00100000:2.0:1780809604.276332:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335069440 00010000:00010000:2.0:1780809604.276347:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 48 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.276381:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 627 00000100:00100000:2.0:1780809604.276389:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4375450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2393:x1867312335069440:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.276401:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809604.276408:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 48 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.276422:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 48 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.276440:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f49ef lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872633 expref: 48 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.276450:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.276454:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.276459:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.276464:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.276481:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809604.276501:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276510:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.276514:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4375450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2393:x1867312335069440:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 126us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.276535:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 627 00000004:00200000:0.0:1780809604.276549:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809604.276554:0:77628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809604.276567:0:77628:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276576:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276583:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276610:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276618:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276626:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809604.276631:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276640:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276691:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809604.276694:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809604.276698:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276703:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e200/0x25b625638c8f4a90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276732:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276737:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276741:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276744:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ea00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809604.276746:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276750:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276755:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54900) 00010000:00010000:0.0:1780809604.276756:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809604.276758:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276762:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ea00/0x25b625638c8f4a97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276784:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4a89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 47 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276803:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 46 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.276818:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809604.276820:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809604.276837:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:0.0:1780809604.276866:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:143417:x1867312335069056:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3170us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809604.276871:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7654 00000100:00100000:0.0:1780809604.278394:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809604.278431:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335069696 00000100:00100000:1.0:1780809604.278436:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335069696 00000100:00100000:1.0:1780809604.278464:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7655 00000100:00100000:1.0:1780809604.278477:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+46:143417:x1867312335069696:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809604.278488:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809604.278497:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687265d expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.278547:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.278555:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 47 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.278562:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.278578:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 47 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.278609:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 47 pid: 77628 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809604.278619:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef0ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338763904:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809604.278656:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae00e4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1780809604.279351:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef0ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338763904:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809604.279362:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809604.279551:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.279582:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335069824 00000100:00100000:2.0:1780809604.279608:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335069824 00010000:00010000:2.0:1780809604.279630:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 48 pid: 77628 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.279659:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 628 00000100:00100000:2.0:1780809604.279666:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:2394:x1867312335069824:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.279675:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809604.279679:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 48 pid: 77628 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.279688:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 48 pid: 77628 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.279698:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4a9e lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872656 expref: 48 pid: 77628 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.279711:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.279713:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.279719:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.279724:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.279748:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809604.279762:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.279782:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:2394:x1867312335069824:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 110us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809604.279783:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.279795:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 628 00000004:00200000:1.0:1780809604.279800:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809604.279905:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 48 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.279926:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 47 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.279935:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809604.279938:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809604.279942:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64200, rc 0) 00000100:00100000:1.0:1780809604.279977:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:143417:x1867312335069696:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1499us (1583us total) trans 55834578855 rc 0/0 00000100:00100000:1.0:1780809604.279985:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7655 00000100:00100000:0.0:1780809604.324690:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809604.324748:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335070080 00000100:00100000:3.0:1780809604.324759:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335070080 00000100:00100000:3.0:1780809604.324813:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1914 00000100:00100000:3.0:1780809604.324836:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+47:143397:x1867312335070080:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809604.325082:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:143397:x1867312335070080:12345-192.168.203.33@tcp:35:dd.0 Request processed in 259us (398us total) trans 55834578856 rc 0/0 00000100:00100000:3.0:1780809604.325092:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1914 00000100:00100000:3.0:1780809604.424681:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.424739:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335070336 00000100:00100000:2.0:1780809604.424749:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335070336 00000100:00100000:2.0:1780809604.424795:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7656 00000100:00100000:2.0:1780809604.424802:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+48:143432:x1867312335070336:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809604.424836:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809604.424855:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872664 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.424920:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.424932:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.424941:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.424950:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.424957:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.424964:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425346:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4acf lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425354:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4acf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425360:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4acf lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809604.425373:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809604.425445:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425451:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425456:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425460:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809604.425463:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425468:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425476:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809604.425478:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809604.425482:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425494:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4ac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425514:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425518:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425522:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425526:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809604.425528:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425531:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425536:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:2.0:1780809604.425538:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809604.425540:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425546:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4ac8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425633:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872664 expref: 51 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425668:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4acf lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872664 expref: 50 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.425677:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.425680:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809604.425683:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935ec00, rc 0) 00000100:00100000:2.0:1780809604.425739:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:143432:x1867312335070336:12345-192.168.203.33@tcp:101:dd.0 Request processed in 936us (1065us total) trans 55834578857 rc 0/0 00000100:00100000:2.0:1780809604.425748:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7656 00000100:00100000:0.0:1780809604.427121:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.427167:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335070464 00000100:00100000:2.0:1780809604.427174:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335070464 00000100:00100000:2.0:1780809604.427217:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2225 00000100:00100000:2.0:1780809604.427227:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:2392:x1867312335070464:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.427239:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809604.427254:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4acf lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872664 expref: 50 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.427282:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.427287:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809604.427319:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:2392:x1867312335070464:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.427327:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2225 00000100:00100000:0.0:1780809604.516584:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809604.516672:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335070592 00000100:00100000:3.0:1780809604.516681:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335070592 00000100:00100000:3.0:1780809604.516726:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7657 00000100:00100000:3.0:1780809604.516734:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+49:143438:x1867312335070592:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1780809604.516753:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809604.516770:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4add lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687266b expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.516831:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.516843:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.516853:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.516867:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.516875:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.516879:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.517181:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.517190:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.517196:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.517220:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 50 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.517231:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 50 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809604.517241:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc50e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338764032:192.168.203.33@tcp:104: 00000100:00100000:3.0:1780809604.517304:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadc3150f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780809604.518305:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc50e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338764032:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809604.518322:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809604.518460:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809604.518497:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335070848 00000100:00100000:1.0:1780809604.518501:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335070848 00000100:00100000:1.0:1780809604.518529:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1915 00000100:00100000:1.0:1780809604.518539:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:89645:x1867312335070848:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809604.518728:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:89645:x1867312335070848:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 192us (269us total) trans 55834578858 rc 0/0 00000100:00100000:1.0:1780809604.518744:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1915 00000100:00100000:3.0:1780809604.519525:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.519585:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335070976 00000100:00100000:2.0:1780809604.519612:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335070976 00010000:00010000:2.0:1780809604.519638:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 52 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.519680:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 629 00000100:00100000:2.0:1780809604.519690:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2393:x1867312335070976:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.519703:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809604.519711:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 52 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.519726:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 52 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.519745:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64200/0x25b625638c8f4aac lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687265d expref: 52 pid: 77627 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.519761:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.519766:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.519776:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.519782:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.519815:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809604.519835:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519843:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.519863:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2393:x1867312335070976:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 175us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.519873:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 629 00000004:00200000:1.0:1780809604.519878:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809604.519883:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809604.519894:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519906:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519917:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519924:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519932:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519939:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030e00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809604.519944:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519952:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519962:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809604.519971:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809604.519977:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519983:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030e00/0x25b625638c8f4ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.519996:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520002:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520008:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520014:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0030200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809604.520017:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520023:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520031:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9caddab91a00) 00010000:00010000:1.0:1780809604.520033:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809604.520036:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520043:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030200/0x25b625638c8f4aeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520079:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030400/0x25b625638c8f4add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 51 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520108:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 50 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.520117:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809604.520119:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809604.520122:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030a00, rc 0) 00000100:00100000:1.0:1780809604.520157:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:143438:x1867312335070592:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3423us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809604.520165:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7657 00000100:00100000:3.0:1780809604.521635:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.521669:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335071232 00000100:00100000:2.0:1780809604.521681:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335071232 00000100:00100000:2.0:1780809604.521710:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7658 00000100:00100000:2.0:1780809604.521716:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+50:143438:x1867312335071232:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809604.521728:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809604.521738:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872672 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.521788:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.521798:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 51 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.521804:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.521835:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 51 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.521845:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 51 pid: 80225 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.521854:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338764160:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809604.521905:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf563e540 going to sleep for 11 seconds 00000100:00100000:2.0:1780809604.522646:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf45cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338764160:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809604.522663:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809604.522850:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.522888:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335071360 00000100:00100000:2.0:1780809604.522894:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335071360 00010000:00010000:2.0:1780809604.522915:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 52 pid: 80225 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.522949:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 630 00000100:00100000:2.0:1780809604.522958:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+52:2394:x1867312335071360:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.522969:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809604.522976:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 52 pid: 80225 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.522989:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 52 pid: 80225 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.523005:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030a00/0x25b625638c8f4af2 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687266b expref: 52 pid: 80225 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.523018:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.523023:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.523031:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.523038:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.523060:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809604.523091:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.523103:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:2394:x1867312335071360:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 143us (249us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809604.523108:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809604.523119:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 630 00000004:00200000:3.0:1780809604.523128:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809604.523237:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 52 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.523277:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 51 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809604.523286:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809604.523290:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809604.523293:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fa00, rc 0) 00000100:00100000:3.0:1780809604.523331:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:143438:x1867312335071232:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1612us (1695us total) trans 55834578859 rc 0/0 00000100:00100000:3.0:1780809604.523341:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7658 00010000:00010000:1.0:1780809604.659787:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809604.764337:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809604.764388:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335071616 00000100:00100000:1.0:1780809604.764398:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335071616 00000100:00100000:1.0:1780809604.764459:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7659 00000100:00100000:1.0:1780809604.764471:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+51:143445:x1867312335071616:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1780809604.764495:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809604.764512:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4b0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872679 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.764575:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.764609:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.764624:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.764657:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.764663:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.764668:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765083:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4b23 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765091:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4b23 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765097:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4b23 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809604.765105:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809604.765175:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765181:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765186:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765190:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809604.765193:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765208:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765217:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809604.765219:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809604.765223:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765227:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64a00/0x25b625638c8f4b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765236:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765240:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765244:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765247:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809604.765249:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765253:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765257:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809604.765258:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809604.765260:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765271:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64800/0x25b625638c8f4b1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765316:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65c00/0x25b625638c8f4b0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872679 expref: 54 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765333:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4b23 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872679 expref: 53 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809604.765341:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809604.765343:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1780809604.765346:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64400, rc 0) 00000100:00100000:1.0:1780809604.765395:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:143445:x1867312335071616:12345-192.168.203.33@tcp:101:dd.0 Request processed in 928us (1067us total) trans 55834578860 rc 0/0 00000100:00100000:1.0:1780809604.765402:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7659 00000100:00100000:0.0:1780809604.766749:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809604.766790:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.766807:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335071744 00000100:00100000:2.0:1780809604.766813:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335071744 00000100:00100000:3.0:1780809604.766871:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335072000 00000100:00100000:2.0:1780809604.766878:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2226 00000100:00100000:3.0:1780809604.766879:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335072000 00000100:00100000:2.0:1780809604.766893:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:2393:x1867312335071744:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.766907:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809604.766925:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1916 00010000:00010000:2.0:1780809604.766926:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64400/0x25b625638c8f4b23 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872679 expref: 54 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809604.766942:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:143445:x1867312335072000:12345-192.168.203.33@tcp:35:dd.0 00010000:00010000:2.0:1780809604.766945:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.766952:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809604.766993:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:2393:x1867312335071744:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.767001:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2226 00000100:00100000:3.0:1780809604.767111:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:143445:x1867312335072000:12345-192.168.203.33@tcp:35:dd.0 Request processed in 173us (319us total) trans 55834578861 rc 0/0 00000100:00100000:3.0:1780809604.767120:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1916 00000100:00100000:0.0:1780809604.815031:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809604.815090:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335072256 00000100:00100000:1.0:1780809604.815098:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335072256 00000100:00100000:1.0:1780809604.815143:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1917 00000100:00100000:1.0:1780809604.815151:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+53:143432:x1867312335072256:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:1.0:1780809604.815359:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:143432:x1867312335072256:12345-192.168.203.33@tcp:35:dd.0 Request processed in 207us (334us total) trans 55834578862 rc 0/0 00000100:00100000:1.0:1780809604.815368:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1917 00000100:00100000:1.0:1780809604.944714:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809604.944772:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335072512 00000100:00100000:0.0:1780809604.944783:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335072512 00000100:00100000:0.0:1780809604.944856:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7660 00000100:00100000:0.0:1780809604.944877:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+54:143453:x1867312335072512:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809604.944907:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809604.944930:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872680 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945006:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945041:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945053:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945080:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945089:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945097:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945502:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4b46 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945514:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4b46 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945523:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4b46 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809604.945534:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809604.945663:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945672:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945680:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945693:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809604.945697:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945705:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945718:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809604.945721:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809604.945727:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945733:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945752:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945759:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945766:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945771:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809604.945774:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945781:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945801:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809604.945803:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809604.945807:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945814:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4b3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945873:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872680 expref: 57 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945889:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4b46 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872680 expref: 56 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809604.945897:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809604.945900:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809604.945904:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cec00, rc 0) 00000100:00100000:0.0:1780809604.945966:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:143453:x1867312335072512:12345-192.168.203.33@tcp:101:dd.0 Request processed in 1099us (1257us total) trans 55834578863 rc 0/0 00000100:00100000:0.0:1780809604.945974:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7660 00000100:00100000:0.0:1780809604.947131:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809604.947195:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335072640 00000100:00100000:2.0:1780809604.947201:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335072640 00000100:00100000:2.0:1780809604.947234:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2227 00000100:00100000:2.0:1780809604.947240:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+56:2394:x1867312335072640:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809604.947248:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809604.947259:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cec00/0x25b625638c8f4b46 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872680 expref: 56 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809604.947281:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809604.947284:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809604.947309:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:2394:x1867312335072640:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.947321:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2227 00000100:00100000:2.0:1780809604.979774:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3442:1867312338764416:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.979783:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338764544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809604.979803:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf60db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338764288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780809604.979861:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809604.979866:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809604.979911:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf60d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338764800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780809604.979937:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338765056:0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.979948:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809604.979979:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338765312:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.979988:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809604.980026:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338765568:0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.980034:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809604.980065:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338764672:0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.980069:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1867312338765824:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.980078:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809604.980117:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1867312338766080:0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.980119:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809604.980121:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809604.980152:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1867312338765184:0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.980161:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1780809604.980169:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809604.980174:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338765440:0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.980241:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809604.980252:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809604.980269:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338764544 00000100:00100000:0.0:1780809604.980270:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3445:1867312338765696:0@lo:400:kworker.0 00000100:00100000:3.0:1780809604.980278:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338764544 00000100:00100000:2.0:1780809604.980286:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338765952:0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.980320:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809604.980333:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765312 00000100:00100000:1.0:1780809604.980340:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765312 00000100:00100000:3.0:1780809604.980342:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338764800 00000100:00100000:3.0:1780809604.980347:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338764800 00000100:00100000:3.0:1780809604.980394:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1780809604.980397:0:77620:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338764416 00000100:00100000:1.0:1780809604.980402:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338764672 00000100:00100000:2.0:1780809604.980405:0:77620:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338764416 00000100:00100000:1.0:1780809604.980409:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338764672 00000100:00100000:0.0:1780809604.980413:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3445:1867312338766208:0@lo:400:kworker.0 00000100:00100000:3.0:1780809604.980442:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadd07c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338764544:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780809604.980447:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1780809604.980459:0:77620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1780809604.980462:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338765312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.980475:0:77620:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3442:x1867312338764416:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1780809604.980497:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:0.0:1780809604.980566:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809604.980613:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338765312:12345-0@lo:400:kworker.0 Request processed in 129us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.980620:0:77620:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3442:x1867312338764416:12345-0@lo:400:kworker.0 Request processed in 147us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809604.980629:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1780809604.980631:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadd07c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338764544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 224us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.980636:0:77620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1780809604.980648:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1780809604.980661:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1780809604.980673:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338764672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809604.980680:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1780809604.980693:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338764800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780809604.980715:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809604.980716:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809604.980729:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338764672:12345-0@lo:400:kworker.0 Request processed in 58us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809604.980737:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1780809604.980770:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338764800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809604.980779:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1780809604.980783:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf60d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338764800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809604.980805:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338765312:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.980810:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765824 00000100:00100000:3.0:1780809604.980814:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765056 00000100:00100000:1.0:1780809604.980829:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765824 00000100:00100000:3.0:1780809604.980832:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765056 00000100:00100000:0.0:1780809604.980835:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338764672:0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.980863:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3442:1867312338764416:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.980866:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338766080 00000100:00100000:1.0:1780809604.980872:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338766080 00000100:00100000:0.0:1780809604.980885:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765568 00000100:00100000:3.0:1780809604.980886:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765440 00000100:00100000:3.0:1780809604.980894:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765440 00000100:00100000:0.0:1780809604.980894:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765568 00000100:00100000:1.0:1780809604.980905:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765184 00000100:00100000:1.0:1780809604.980910:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765184 00000100:00100000:2.0:1780809604.980922:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765696 00000100:00100000:2.0:1780809604.980929:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765696 00000100:00100000:3.0:1780809604.980937:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1780809604.980937:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338766208 00000100:00100000:1.0:1780809604.980944:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338766208 00000100:00100000:0.0:1780809604.980947:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1780809604.980953:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338765056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.980962:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338765952 00000100:00100000:0.0:1780809604.980962:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338765440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.980970:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338765952 00000100:00100000:1.0:1780809604.980989:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1780809604.981002:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1867312338765824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809604.981004:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338765056:12345-0@lo:400:kworker.0 Request processed in 55us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.981014:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1780809604.981020:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1780809604.981022:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338765440:12345-0@lo:400:kworker.0 Request processed in 63us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809604.981030:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1867312338766080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.981034:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1780809604.981042:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1780809604.981052:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caddec70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338765568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981062:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1867312338765824:12345-0@lo:400:kworker.0 Request processed in 63us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809604.981072:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1780809604.981076:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338765440:0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.981096:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1867312338765824:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981102:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1780809604.981106:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1867312338766080:12345-0@lo:400:kworker.0 Request processed in 78us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809604.981107:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caddec70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338765568:12345-0@lo:400:kworker.0 Request processed in 54us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809604.981120:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1780809604.981120:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1867312338765184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.981126:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:2.0:1780809604.981136:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1780809604.981140:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3445:x1867312338765696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.981169:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1780809604.981183:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3445:x1867312338766208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981192:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1867312338765184:12345-0@lo:400:kworker.0 Request processed in 77us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809604.981194:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3445:x1867312338765696:12345-0@lo:400:kworker.0 Request processed in 57us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809604.981209:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1780809604.981217:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1780809604.981240:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3445:x1867312338766208:12345-0@lo:400:kworker.0 Request processed in 59us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809604.981251:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1867312338765184:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981252:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1780809604.981264:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1780809604.981269:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338765952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.981279:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3445:1867312338765696:0@lo:400:kworker.0 00010000:00080000:0.0:1780809604.981302:0:3445:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caded24fb80 x1867312338766208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780809604.981314:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3445:1867312338766208:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981328:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338765952:12345-0@lo:400:kworker.0 Request processed in 63us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809604.981339:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1780809604.981345:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1780809604.981382:0:3442:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caded24e300 x1867312338765952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809604.981383:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338764928:0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.981398:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338765952:0@lo:400:kworker.0 00000100:00100000:2.0:1780809604.981429:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780809604.981432:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780809604.981436:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780809604.981439:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780809604.981441:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780809604.981464:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338764928 00000100:00100000:3.0:1780809604.981468:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338764928 00000100:00100000:0.0:1780809604.981468:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338765056:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981474:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338764288 00000100:00100000:1.0:1780809604.981482:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338764288 00000100:00100000:0.0:1780809604.981485:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338765568:0@lo:400:kworker.0 00000100:00100000:0.0:1780809604.981501:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1867312338766080:0@lo:400:kworker.0 00000100:00100000:3.0:1780809604.981514:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1780809604.981523:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338764544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809604.981526:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338764928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981532:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1780809604.981546:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338764288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780809604.981560:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:3.0:1780809604.981577:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338764928:12345-0@lo:400:kworker.0 Request processed in 53us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809604.981585:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00080000:3.0:1780809604.981643:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780809604.981646:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338764288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809604.981647:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338764928:0@lo:400:kworker.0 00000100:00100000:1.0:1780809604.981662:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1780809604.981689:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf60db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338764288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780809605.221579:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.221653:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335072896 00000100:00100000:2.0:1780809605.221665:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335072896 00000100:00100000:2.0:1780809605.221727:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7661 00000100:00100000:2.0:1780809605.221739:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+55:143459:x1867312335072896:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809605.221764:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809605.221781:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872687 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.221875:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.221887:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.221896:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.221905:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.221910:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.221914:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222198:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4b69 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222205:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4b69 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222210:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4b69 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809605.222217:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809605.222298:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222316:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222321:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222325:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809605.222328:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222334:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222342:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809605.222344:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809605.222348:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222352:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222376:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222384:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222391:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222396:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809605.222406:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222422:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222431:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54000) 00010000:00010000:2.0:1780809605.222434:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809605.222438:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222445:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222498:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872687 expref: 58 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222515:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4b69 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872687 expref: 57 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.222524:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.222527:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809605.222530:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e400, rc 0) 00000100:00100000:2.0:1780809605.222620:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:143459:x1867312335072896:12345-192.168.203.33@tcp:101:dd.0 Request processed in 851us (1018us total) trans 55834578864 rc 0/0 00000100:00100000:2.0:1780809605.222629:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7661 00000100:00100000:1.0:1780809605.223747:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.223792:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335073024 00000100:00100000:2.0:1780809605.223797:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335073024 00000100:00100000:1.0:1780809605.223801:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.223844:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2228 00000100:00100000:2.0:1780809605.223853:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4375850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312335073024:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1780809605.223862:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335073280 00010000:00010000:2.0:1780809605.223866:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809605.223869:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335073280 00010000:00010000:2.0:1780809605.223889:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4b69 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872687 expref: 58 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.223906:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.223909:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780809605.223914:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1918 00000100:00100000:3.0:1780809605.223927:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc37db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:143459:x1867312335073280:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:2.0:1780809605.223936:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4375850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:2393:x1867312335073024:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 84us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809605.223943:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2228 00000100:00100000:3.0:1780809605.224055:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc37db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:143459:x1867312335073280:12345-192.168.203.33@tcp:35:dd.0 Request processed in 130us (252us total) trans 55834578865 rc 0/0 00000100:00100000:3.0:1780809605.224065:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1918 00000100:00100000:1.0:1780809605.265633:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.265698:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335073408 00000100:00100000:2.0:1780809605.265709:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335073408 00000100:00100000:2.0:1780809605.265769:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7662 00000100:00100000:2.0:1780809605.265780:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+57:143465:x1867312335073408:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809605.265811:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809605.265841:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4b77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687268e expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.265895:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.265906:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.265914:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.265923:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.265937:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.265941:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.266274:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.266286:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 58 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.266294:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.266324:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 58 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.266339:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 58 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.266352:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338766336:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809605.266434:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae00e4e480 going to sleep for 11 seconds 00000100:00100000:2.0:1780809605.267389:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338766336:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809605.267408:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809605.267493:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.267616:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335073664 00000100:00100000:0.0:1780809605.267622:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335073664 00000100:00100000:0.0:1780809605.267669:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1919 00000100:00100000:0.0:1780809605.267681:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:89645:x1867312335073664:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809605.267908:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:89645:x1867312335073664:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 229us (413us total) trans 55834578866 rc 0/0 00000100:00100000:0.0:1780809605.267925:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1919 00000100:00100000:0.0:1780809605.268788:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.268852:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335073792 00000100:00100000:2.0:1780809605.268865:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335073792 00010000:00010000:2.0:1780809605.268887:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 60 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.268927:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 631 00000100:00100000:2.0:1780809605.268936:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2394:x1867312335073792:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.268947:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.268954:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 60 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.268968:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 60 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.268988:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4b00 lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872672 expref: 60 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.269016:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.269022:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.269033:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.269041:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.269065:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809605.269101:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2394:x1867312335073792:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 164us (313us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809605.269103:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269117:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.269127:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 631 00000004:00200000:1.0:1780809605.269155:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809605.269161:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809605.269177:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269189:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269199:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269206:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269214:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269220:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809605.269225:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269233:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269243:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809605.269247:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809605.269258:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269264:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4b7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269280:0:78216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269287:0:78216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269293:0:78216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269299:0:78216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809605.269302:0:78216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269309:0:78216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269316:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54000) 00010000:00010000:1.0:1780809605.269318:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809605.269322:0:78216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269327:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4b85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269359:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4b77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 59 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269395:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 58 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.269403:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809605.269406:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809605.269409:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e000, rc 0) 00000100:00100000:1.0:1780809605.269445:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:143465:x1867312335073408:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3667us (3818us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809605.269453:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7662 00000100:00100000:0.0:1780809605.271274:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.271327:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335074048 00000100:00100000:2.0:1780809605.271333:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335074048 00000100:00100000:2.0:1780809605.271367:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7663 00000100:00100000:2.0:1780809605.271377:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+58:143465:x1867312335074048:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809605.271398:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809605.271412:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e31046872695 expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.271482:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.271495:0:77628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 59 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.271501:0:77628:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.271532:0:77628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 59 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.271547:0:77628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 59 pid: 78216 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.271561:0:77628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338766464:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809605.271646:0:77628:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae00e4e480 going to sleep for 11 seconds 00000100:00100000:2.0:1780809605.272511:0:77628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:77628:1867312338766464:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809605.272540:0:77628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809605.273058:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.273103:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335074176 00000100:00100000:2.0:1780809605.273107:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335074176 00010000:00010000:2.0:1780809605.273127:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 60 pid: 78216 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.273152:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 632 00000100:00100000:2.0:1780809605.273158:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:2393:x1867312335074176:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.273167:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.273172:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 60 pid: 78216 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.273181:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 60 pid: 78216 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.273193:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4b8c lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e3104687268e expref: 60 pid: 78216 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.273213:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.273216:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.273222:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.273227:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.273252:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809605.273282:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:2393:x1867312335074176:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 124us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809605.273288:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 632 00010000:00010000:0.0:1780809605.273299:0:77628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.273311:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809605.273333:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809605.273485:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 60 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.273500:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 59 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.273506:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809605.273508:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780809605.273510:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f800, rc 0) 00000100:00100000:0.0:1780809605.273539:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:143465:x1867312335074048:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2164us (2269us total) trans 55834578867 rc 0/0 00000100:00100000:0.0:1780809605.273544:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7663 00000100:00100000:0.0:1780809605.298300:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809605.298378:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335074432 00000100:00100000:3.0:1780809605.298388:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335074432 00000100:00100000:3.0:1780809605.298448:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1920 00000100:00100000:3.0:1780809605.298460:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+59:143453:x1867312335074432:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:3.0:1780809605.298716:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:143453:x1867312335074432:12345-192.168.203.33@tcp:35:dd.0 Request processed in 259us (425us total) trans 55834578868 rc 0/0 00000100:00100000:3.0:1780809605.298722:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1920 00000100:00100000:3.0:1780809605.385744:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.385802:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335074688 00000100:00100000:0.0:1780809605.385812:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335074688 00000100:00100000:0.0:1780809605.385886:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7664 00000100:00100000:0.0:1780809605.385897:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+60:143480:x1867312335074688:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1780809605.385922:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809605.385942:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4ba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e3104687269c expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386012:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386027:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386052:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386066:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386074:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386080:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386463:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4bbd lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386473:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4bbd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386481:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4bbd lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780809605.386490:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:0.0:1780809605.386575:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386583:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386620:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386626:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cee00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809605.386637:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386646:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386659:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809605.386663:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809605.386669:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386676:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4baf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386694:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386699:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386703:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386706:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91ce600 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809605.386708:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386712:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386717:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83d00) 00010000:00010000:0.0:1780809605.386719:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809605.386726:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386730:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386762:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4ba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687269c expref: 63 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386772:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4bbd lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687269c expref: 62 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.386778:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809605.386779:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1780809605.386781:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce800, rc 0) 00000100:00100000:0.0:1780809605.386843:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:143480:x1867312335074688:12345-192.168.203.33@tcp:101:dd.0 Request processed in 948us (1108us total) trans 55834578869 rc 0/0 00000100:00100000:0.0:1780809605.386849:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7664 00000100:00100000:1.0:1780809605.388436:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.388492:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335074816 00000100:00100000:2.0:1780809605.388497:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335074816 00000100:00100000:2.0:1780809605.388542:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2229 00000100:00100000:2.0:1780809605.388552:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:2391:x1867312335074816:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.388565:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.388584:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce800/0x25b625638c8f4bbd lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e3104687269c expref: 62 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.388638:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.388643:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809605.388687:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:2391:x1867312335074816:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809605.388700:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2229 00000100:00100000:3.0:1780809605.410676:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809605.410748:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335074944 00000100:00100000:1.0:1780809605.410760:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335074944 00000100:00100000:1.0:1780809605.410811:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7665 00000100:00100000:1.0:1780809605.410834:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+61:143487:x1867312335074944:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1780809605.410856:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809605.410873:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f4bcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726a3 expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.410926:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.410938:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.410947:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.410971:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.410976:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.410981:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.411365:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.411379:0:80225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 62 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.411388:0:80225:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.411423:0:80225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 62 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.411438:0:80225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 62 pid: 77628 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780809605.411455:0:80225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc5e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338766592:192.168.203.33@tcp:104: 00000100:00100000:1.0:1780809605.411541:0:80225:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadf551d540 going to sleep for 11 seconds 00000100:00100000:1.0:1780809605.412429:0:80225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc5e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80225:1867312338766592:192.168.203.33@tcp:104: 00010000:00010000:1.0:1780809605.412448:0:80225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809605.412661:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.412705:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335075200 00000100:00100000:0.0:1780809605.412711:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335075200 00000100:00100000:0.0:1780809605.412799:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1921 00000100:00100000:0.0:1780809605.412805:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:89645:x1867312335075200:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809605.412986:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:89645:x1867312335075200:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 179us (324us total) trans 55834578870 rc 0/0 00000100:00100000:0.0:1780809605.412992:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1921 00000100:00100000:3.0:1780809605.413670:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.413723:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335075328 00000100:00100000:2.0:1780809605.413728:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335075328 00010000:00010000:2.0:1780809605.413748:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 64 pid: 77628 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.413773:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 633 00000100:00100000:2.0:1780809605.413779:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2394:x1867312335075328:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.413786:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.413798:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 64 pid: 77628 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.413809:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 64 pid: 77628 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.413839:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4b9a lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e31046872695 expref: 64 pid: 77628 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.413866:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.413872:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.413881:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.413889:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.413915:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809605.413945:0:80225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.413952:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2394:x1867312335075328:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 169us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809605.413965:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 633 00010000:00010000:1.0:1780809605.413973:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809605.414004:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809605.414010:0:80225:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809605.414025:0:80225:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414036:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414044:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414049:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414054:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414058:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f65a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809605.414061:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414066:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414073:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809605.414081:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809605.414085:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414089:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414098:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414102:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414107:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414110:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadf5f64c00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809605.414112:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414115:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414120:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadd479f200) 00010000:00010000:1.0:1780809605.414121:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809605.414123:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414127:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4bd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414152:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64e00/0x25b625638c8f4bcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 63 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414171:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 62 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.414177:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809605.414178:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809605.414180:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64000, rc 0) 00000100:00100000:1.0:1780809605.414208:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:143487:x1867312335074944:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3376us (3540us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809605.414213:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7665 00000100:00100000:3.0:1780809605.415706:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.415753:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335075584 00000100:00100000:0.0:1780809605.415757:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335075584 00000100:00100000:0.0:1780809605.415783:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7666 00000100:00100000:0.0:1780809605.415795:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+62:143487:x1867312335075584:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809605.415806:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809605.415830:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4be7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726aa expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.415878:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.415887:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 63 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.415893:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.415909:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 63 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.415922:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 63 pid: 80225 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809605.415934:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338766720:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809605.415983:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadded7e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780809605.416632:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338766720:192.168.203.33@tcp:104: 00010000:00010000:3.0:1780809605.416650:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809605.416833:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.416872:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335075712 00000100:00100000:2.0:1780809605.416878:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335075712 00010000:00010000:2.0:1780809605.416898:0:77612:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 64 pid: 80225 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.416932:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 634 00000100:00100000:2.0:1780809605.416943:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:2393:x1867312335075712:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.416959:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.416967:0:77612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 64 pid: 80225 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.416982:0:77612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 64 pid: 80225 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.416997:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64000/0x25b625638c8f4be0 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726a3 expref: 64 pid: 80225 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.417009:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.417014:0:77612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.417022:0:77612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.417029:0:77612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.417049:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780809605.417074:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.417080:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:2393:x1867312335075712:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 139us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1780809605.417086:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.417091:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 634 00000004:00200000:3.0:1780809605.417102:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:3.0:1780809605.417188:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf600/0x25b625638c8f4be7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 64 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809605.417204:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 63 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809605.417209:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809605.417211:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809605.417213:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce600, rc 0) 00000100:00100000:3.0:1780809605.417243:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:143487:x1867312335075584:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1447us (1537us total) trans 55834578871 rc 0/0 00000100:00100000:3.0:1780809605.417250:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7666 00000100:00100000:0.0:1780809605.491807:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338766848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780809605.491897:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809605.491949:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338766848 00000100:00100000:2.0:1780809605.491959:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338766848 00000100:00100000:2.0:1780809605.492021:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1780809605.492034:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338766848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780809605.492091:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:2.0:1780809605.492153:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338766848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809605.492162:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1780809605.492203:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338766848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780809605.551765:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.551835:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335075840 00000100:00100000:2.0:1780809605.551844:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335075840 00000100:00100000:2.0:1780809605.551891:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7667 00000100:00100000:2.0:1780809605.551899:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+63:143494:x1867312335075840:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809605.551919:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809605.551936:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4bfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726b1 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.551989:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552002:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552011:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552021:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552026:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552031:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552401:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552414:0:77627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 64 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552424:0:77627:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552457:0:77627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 64 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.552471:0:77627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 64 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.552486:0:77627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc962300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338766976:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809605.552562:0:77627:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae00e4e480 going to sleep for 11 seconds 00000100:00100000:2.0:1780809605.553448:0:77627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc962300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:77627:1867312338766976:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809605.553465:0:77627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809605.553558:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.553653:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335076096 00000100:00100000:0.0:1780809605.553659:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335076096 00000100:00100000:0.0:1780809605.553701:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1922 00000100:00100000:0.0:1780809605.553708:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:89646:x1867312335076096:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1780809605.553881:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:89646:x1867312335076096:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 173us (322us total) trans 55834578872 rc 0/0 00000100:00100000:0.0:1780809605.553887:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1922 00000100:00100000:0.0:1780809605.554611:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.554654:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335076224 00000100:00100000:2.0:1780809605.554659:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335076224 00010000:00010000:2.0:1780809605.554680:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 66 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.554708:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 635 00000100:00100000:2.0:1780809605.554732:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2393:x1867312335076224:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.554744:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.554751:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 66 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.554764:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 66 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.554782:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce600/0x25b625638c8f4bee lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726aa expref: 66 pid: 77629 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.554808:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.554824:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.554833:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.554840:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.554861:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809605.554885:0:77627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.554893:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2393:x1867312335076224:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 169us (279us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809605.554898:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.554908:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 635 00000004:00200000:1.0:1780809605.554927:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:1.0:1780809605.554932:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809605.554944:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.554953:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.554960:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.554964:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.554976:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.554980:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935e000 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809605.554983:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.554989:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.554996:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:1.0:1780809605.554998:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809605.555001:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555006:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e000/0x25b625638c8f4c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555025:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555030:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555034:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555038:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935fa00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:1.0:1780809605.555040:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555056:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555062:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54500) 00010000:00010000:1.0:1780809605.555064:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780809605.555066:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555070:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fa00/0x25b625638c8f4c0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555103:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f800/0x25b625638c8f4bfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 65 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555117:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 64 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.555123:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809605.555125:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780809605.555126:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00000100:00100000:1.0:1780809605.555153:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:143494:x1867312335075840:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3256us (3400us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809605.555159:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7667 00000100:00100000:0.0:1780809605.556566:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.556634:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335076480 00000100:00100000:2.0:1780809605.556640:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335076480 00000100:00100000:2.0:1780809605.556673:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7668 00000100:00100000:2.0:1780809605.556681:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+64:143494:x1867312335076480:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809605.556700:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809605.556712:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4c18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726b8 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.556774:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.556787:0:78216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 65 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.556795:0:78216:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.556831:0:78216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 65 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.556842:0:78216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 65 pid: 77627 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.556854:0:78216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc962300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338767104:192.168.203.33@tcp:104: 00000100:00100000:2.0:1780809605.556902:0:78216:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cae00e4e480 going to sleep for 11 seconds 00000100:00100000:2.0:1780809605.557729:0:78216:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc962300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:78216:1867312338767104:192.168.203.33@tcp:104: 00010000:00010000:2.0:1780809605.557743:0:78216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809605.557899:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.557946:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335076608 00000100:00100000:2.0:1780809605.557951:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335076608 00010000:00010000:2.0:1780809605.557972:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 66 pid: 77627 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.558013:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 636 00000100:00100000:2.0:1780809605.558022:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4374c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+66:2394:x1867312335076608:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.558035:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.558042:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 66 pid: 77627 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.558055:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 66 pid: 77627 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.558071:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c11 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b1 expref: 66 pid: 77627 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.558092:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.558097:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.558105:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.558112:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.558136:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809605.558167:0:78216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.558169:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4374c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:2394:x1867312335076608:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 147us (270us total) trans 0 rc 0/0 00010000:00010000:1.0:1780809605.558187:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.558188:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 636 00000004:00200000:1.0:1780809605.558225:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:1.0:1780809605.558327:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e400/0x25b625638c8f4c18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 66 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.558347:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 65 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809605.558357:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:1.0:1780809605.558359:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1780809605.558361:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935f200, rc 0) 00000100:00100000:1.0:1780809605.558394:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:143494:x1867312335076480:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1713us (1828us total) trans 55834578873 rc 0/0 00000100:00100000:1.0:1780809605.558402:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7668 00010000:00010000:1.0:1780809605.683857:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809605.730409:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.730474:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335076864 00000100:00100000:2.0:1780809605.730501:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335076864 00000100:00100000:2.0:1780809605.730547:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7669 00000100:00100000:2.0:1780809605.730555:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+65:143501:x1867312335076864:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809605.730576:0:77628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809605.730620:0:77628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726bf expref: -99 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.730683:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.730695:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.730703:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.730717:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.730725:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.730732:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731090:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4c42 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731098:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4c42 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731104:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4c42 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809605.731117:0:77628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00010000:00010000:2.0:1780809605.731207:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731214:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731218:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731222:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935f400 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809605.731225:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731231:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731240:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:2.0:1780809605.731242:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809605.731246:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731258:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f400/0x25b625638c8f4c34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731281:0:77628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731286:0:77628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731298:0:77628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731301:0:77628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc935ec00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:2.0:1780809605.731303:0:77628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731307:0:77628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731312:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cadc2e54800) 00010000:00010000:2.0:1780809605.731314:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780809605.731316:0:77628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731319:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935ec00/0x25b625638c8f4c3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731359:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726bf expref: 68 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731369:0:77628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4c42 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726bf expref: 67 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.731375:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.731377:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1780809605.731379:0:77628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935fe00, rc 0) 00000100:00100000:2.0:1780809605.731426:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:143501:x1867312335076864:12345-192.168.203.33@tcp:101:dd.0 Request processed in 872us (1028us total) trans 55834578874 rc 0/0 00000100:00100000:2.0:1780809605.731439:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7669 00000100:00100000:3.0:1780809605.732830:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.732884:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335077120 00000100:00100000:0.0:1780809605.732890:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335077120 00000100:00100000:0.0:1780809605.732930:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1923 00000100:00100000:0.0:1780809605.732940:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:143501:x1867312335077120:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809605.733140:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:143501:x1867312335077120:12345-192.168.203.33@tcp:35:dd.0 Request processed in 200us (310us total) trans 55834578875 rc 0/0 00000100:00100000:0.0:1780809605.733149:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1923 00000100:00100000:1.0:1780809605.733163:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.733206:0:77612:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335077248 00000100:00100000:2.0:1780809605.733211:0:77612:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335077248 00000100:00100000:2.0:1780809605.733266:0:77612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2230 00000100:00100000:2.0:1780809605.733275:0:77612:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:2394:x1867312335077248:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.733286:0:77612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.733298:0:77612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4c42 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726bf expref: 68 pid: 77628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.733313:0:77612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.733316:0:77612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780809605.733345:0:77612:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:2394:x1867312335077248:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809605.733350:0:77612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2230 00000100:00100000:3.0:1780809605.774298:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.774372:0:77630:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335077504 00000100:00100000:0.0:1780809605.774382:0:77630:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335077504 00000100:00100000:0.0:1780809605.774435:0:77630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1924 00000100:00100000:0.0:1780809605.774446:0:77630:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc37da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+67:143480:x1867312335077504:12345-192.168.203.33@tcp:35:dd.0 00000100:00100000:0.0:1780809605.774702:0:77630:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc37da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:143480:x1867312335077504:12345-192.168.203.33@tcp:35:dd.0 Request processed in 257us (413us total) trans 55834578876 rc 0/0 00000100:00100000:0.0:1780809605.774713:0:77630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1924 00000100:00100000:3.0:1780809605.996418:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809605.996474:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335077632 00000100:00100000:0.0:1780809605.996491:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335077632 00000100:00100000:0.0:1780809605.996541:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7670 00000100:00100000:0.0:1780809605.996548:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+68:143511:x1867312335077632:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1780809605.996619:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809605.996642:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4c50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726c6 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.996715:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.996748:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.996762:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.996779:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.996787:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.996795:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.997173:0:79214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.997187:0:79214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 2/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 69 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.997197:0:79214:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 4/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.997230:0:79214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 69 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809605.997253:0:79214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 69 pid: 78216 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809605.997269:0:79214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338767232:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809605.997355:0:79214:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadded7e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809605.998583:0:79214:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:79214:1867312338767232:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809605.998635:0:79214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809605.998638:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809605.998692:0:77631:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335077888 00000100:00100000:1.0:1780809605.998698:0:77631:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335077888 00000100:00100000:1.0:1780809605.998727:0:77631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1925 00000100:00100000:1.0:1780809605.998734:0:77631:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:89645:x1867312335077888:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1780809605.998942:0:77631:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:89645:x1867312335077888:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 207us (306us total) trans 55834578877 rc 0/0 00000100:00100000:1.0:1780809605.998951:0:77631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1925 00000100:00100000:1.0:1780809605.999694:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809605.999766:0:77614:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335078016 00000100:00100000:2.0:1780809605.999772:0:77614:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335078016 00010000:00010000:2.0:1780809605.999798:0:77614:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 71 pid: 78216 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809605.999847:0:77614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 637 00000100:00100000:2.0:1780809605.999857:0:77614:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+71:2393:x1867312335078016:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809605.999870:0:77614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780809605.999878:0:77614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 4/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 71 pid: 78216 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.999892:0:77614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 71 pid: 78216 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.999921:0:77614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935f200/0x25b625638c8f4c1f lrc: 0/0,0 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726b8 expref: 71 pid: 78216 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.999949:0:77614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809605.999955:0:77614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.999964:0:77614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.999972:0:77614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 4/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809605.999997:0:77614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809606.000021:0:79214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000029:0:79214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809606.000041:0:77614:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+70:2393:x1867312335078016:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 184us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809606.000050:0:77614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 637 00000004:00200000:0.0:1780809606.000057:0:79214:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000004:00200000:0.0:1780809606.000062:0:79214:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780809606.000075:0:79214:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000085:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000092:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000100:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000122:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000129:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cee00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809606.000134:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000144:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000155:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809606.000159:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809606.000163:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000170:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4c57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000228:0:79214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000233:0:79214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000237:0:79214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000241:0:79214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809606.000243:0:79214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000255:0:79214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000262:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1120c563 (ffff9cacc5b83700) 00010000:00010000:0.0:1780809606.000263:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809606.000265:0:79214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000270:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1120c563 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 79214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000294:0:79214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4c50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 70 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000304:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 69 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.000309:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:0.0:1780809606.000311:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809606.000313:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cfa00, rc 0) 00000100:00100000:0.0:1780809606.000338:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:143511:x1867312335077632:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3791us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809606.000343:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7670 00000100:00100000:1.0:1780809606.001577:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809606.001659:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335078272 00000100:00100000:2.0:1780809606.001665:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335078272 00000100:00100000:2.0:1780809606.001719:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7671 00000100:00080000:3.0:1780809606.001725:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780809606.001732:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+69:143515:x1867312335078272:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1780809606.001749:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780809606.001762:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4c6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726cd expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809606.001848:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c73 lrc: 3/1,0 mode: --/CR res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809606.001873:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c73 lrc: 3/1,0 mode: CR/CR res: [0x2000061c1:0x84:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809606.001883:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c73 lrc: 3/1,0 mode: CR/CR res: [0x2000061c1:0x84:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780809606.001895:0:80225:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:3.0:1780809606.001953:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:2.0:1780809606.002000:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935fe00/0x25b625638c8f4c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726cd expref: 72 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809606.002003:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335078528 00000100:00100000:0.0:1780809606.002009:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335078528 00010000:00010000:2.0:1780809606.002031:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc935e600/0x25b625638c8f4c73 lrc: 3/0,0 mode: CR/CR res: [0x2000061c1:0x84:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726cd expref: 72 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809606.002040:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7672 00010000:00010000:2.0:1780809606.002045:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00000100:00100000:0.0:1780809606.002050:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:143511:x1867312335078528:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1780809606.002052:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1780809606.002058:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc935e600, rc 0) 00010000:00010000:0.0:1780809606.002070:0:77629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809606.002081:0:77629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f4c81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726d4 expref: -99 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809606.002103:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:143515:x1867312335078272:12345-192.168.203.33@tcp:101:dd.0 Request processed in 372us (525us total) trans 55834578878 rc 0/0 00000100:00100000:2.0:1780809606.002113:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7671 00010000:00010000:0.0:1780809606.002134:0:77629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.002150:0:77629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 2/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 72 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.002159:0:77629:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 4/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.002186:0:77629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 72 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809606.002244:0:77629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 72 pid: 79214 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809606.002255:0:77629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338767360:192.168.203.33@tcp:104: 00000100:00100000:0.0:1780809606.002308:0:77629:0:(client.c:2692:ptlrpc_set_wait()) set ffff9cadded7e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780809606.003233:0:77629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:77629:1867312338767360:192.168.203.33@tcp:104: 00010000:00010000:0.0:1780809606.003249:0:77629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809606.003535:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809606.003575:0:80148:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335078656 00000100:00100000:2.0:1780809606.003581:0:80148:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335078656 00010000:00010000:2.0:1780809606.003646:0:80148:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 73 pid: 79214 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780809606.003682:0:80148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 638 00000100:00100000:2.0:1780809606.003695:0:80148:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+73:2394:x1867312335078656:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780809606.003715:0:80148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780809606.003718:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc50e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338767488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1780809606.003736:0:80148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 4/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 73 pid: 79214 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809606.003756:0:80148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 73 pid: 79214 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780809606.003765:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780809606.003785:0:80148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfa00/0x25b625638c8f4c65 lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xfe54e310468726c6 expref: 73 pid: 79214 timeout: 1968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780809606.003799:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338767488 00000100:00100000:0.0:1780809606.003805:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338767488 00010000:00010000:2.0:1780809606.003807:0:80148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:2.0:1780809606.003826:0:80148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 3/0,1 mode: --/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809606.003835:0:80148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780809606.003842:0:80148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 4/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780809606.003850:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780809606.003872:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00010000:00010000:2.0:1780809606.003873:0:80148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780809606.003895:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caccdc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338767488:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780809606.003898:0:77629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809606.003910:0:77629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 3/0,1 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77629 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1780809606.003917:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809606.003920:0:80148:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:2394:x1867312335078656:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 220us (376us total) trans 0 rc 0/0 00000004:00200000:3.0:1780809606.003927:0:77629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x84:0x0]: returning size 52428800 00000100:00100000:2.0:1780809606.003933:0:80148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 638 00000100:00100000:0.0:1780809606.003975:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caccdc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338767488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809606.003984:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1780809606.003996:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc50e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338767488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780809606.004039:0:77629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf000/0x25b625638c8f4c81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726d4 expref: 73 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809606.004058:0:77629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf200/0x25b625638c8f4c88 lrc: 3/0,0 mode: CW/CW res: [0x2000061c1:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726d4 expref: 72 pid: 77629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809606.004066:0:77629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x84:0x0].0x0 (ffff9cadc2e54600) 00010000:00010000:3.0:1780809606.004069:0:77629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780809606.004072:0:77629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91cf200, rc 0) 00000100:00100000:3.0:1780809606.004103:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+72:143511:x1867312335078528:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2053us (2149us total) trans 55834578879 rc 0/0 00000100:00100000:3.0:1780809606.004120:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7672 00000100:00100000:3.0:1780809606.653962:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809606.654003:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809606.654018:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335078784 00000100:00100000:2.0:1780809606.654027:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335078784 00000100:00100000:3.0:1780809606.654044:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809606.654066:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809606.654069:0:78806:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079040 00000100:00100000:0.0:1780809606.654076:0:78806:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079040 00000100:00100000:2.0:1780809606.654088:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 393 00000100:00100000:1.0:1780809606.654097:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079296 00000100:00100000:3.0:1780809606.654098:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809606.654103:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312335078784:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809606.654110:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079296 00000100:00080000:3.0:1780809606.654121:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780809606.654128:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780809606.654141:0:78806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 674 00000100:00100000:1.0:1780809606.654147:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335078912 00000100:00100000:1.0:1780809606.654151:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335078912 00000100:00100000:0.0:1780809606.654154:0:78806:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2392:x1867312335079040:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809606.654169:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2392:x1867312335078784:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809606.654182:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 393 00000100:00100000:0.0:1780809606.654195:0:78806:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2392:x1867312335079040:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 45us (191us total) trans 0 rc 0/0 00000100:00080000:3.0:1780809606.654198:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780809606.654203:0:78806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 674 00000100:00100000:3.0:1780809606.654216:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079168 00000100:00100000:3.0:1780809606.654222:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079168 00000100:00100000:0.0:1780809606.654229:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1120 00000100:00100000:0.0:1780809606.654237:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335079296:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:3.0:1780809606.654246:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809606.654268:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335079296:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809606.654276:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1120 00000100:00100000:2.0:1780809606.654286:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1121 00000100:00100000:3.0:1780809606.654313:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1122 00000100:00100000:2.0:1780809606.654319:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335079168:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809606.654329:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2392:x1867312335078912:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809606.654366:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2392:x1867312335079168:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809606.654369:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2392:x1867312335078912:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809606.654376:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1121 00000100:00100000:3.0:1780809606.654384:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1122 00010000:00010000:1.0:1780809606.707814:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1780809606.900090:0:77663:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1780809607.034450:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578876 is committed 00000001:00080000:2.0:1780809607.034498:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578877 is committed 00000001:00080000:2.0:1780809607.034521:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578878 is committed 00000001:00080000:2.0:1780809607.034535:0:6395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 55834578879 is committed 00010000:00010000:1.0:1780809607.731783:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809608.755732:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809609.075745:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338767616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780809609.075817:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809609.075850:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338767616 00000100:00100000:1.0:1780809609.075859:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338767616 00000100:00100000:1.0:1780809609.075900:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1780809609.075909:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338767616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780809609.075938:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1780809609.075995:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338767616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809609.076003:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1780809609.076028:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338767616:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1780809609.779750:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809610.099744:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3445:1867312338768000:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.099774:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338767872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809610.099845:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809610.099848:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809610.099892:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338767872 00000100:00100000:0.0:1780809610.099900:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338767872 00000100:00100000:3.0:1780809610.099910:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc5e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338767744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780809610.099924:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338768384:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.099942:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809610.099963:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809610.099965:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338768512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780809610.099969:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338767744 00000100:00100000:0.0:1780809610.099974:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338767744 00000100:00100000:1.0:1780809610.099994:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338768896:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100000:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809610.100007:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768512 00000100:00100000:0.0:1780809610.100011:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768512 00000100:00100000:3.0:1780809610.100021:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338769024:0@lo:400:kworker.0 00000100:00100000:2.0:1780809610.100028:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338768128:0@lo:400:kworker.0 00000100:00100000:1.0:1780809610.100035:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809610.100039:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1780809610.100058:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809610.100062:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3445:1867312338769408:0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100068:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338767872:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809610.100077:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809610.100083:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1867312338769536:0@lo:400:kworker.0 00000100:00100000:1.0:1780809610.100103:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1780809610.100106:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809610.100107:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338768640:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100126:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809610.100133:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780809610.100145:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338768256:0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100167:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338767872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809610.100179:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1780809610.100182:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc2914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338767872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809610.100185:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809610.100197:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768000 00000100:00100000:1.0:1780809610.100203:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768000 00000100:00100000:2.0:1780809610.100211:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338769152:0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100213:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00080000:3.0:1780809610.100218:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780809610.100223:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780809610.100227:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338767744:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809610.100238:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768384 00000100:00100000:2.0:1780809610.100238:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809610.100244:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768384 00002000:00000024:0.0:1780809610.100249:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809610.100259:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338769664:0@lo:400:kworker.0 00000100:00100000:1.0:1780809610.100264:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1780809610.100277:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3445:x1867312338768000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100282:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768896 00000100:00100000:3.0:1780809610.100286:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768896 00000100:00100000:2.0:1780809610.100301:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809610.100302:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3442:x1867312338767744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809610.100311:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1780809610.100314:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769024 00000100:00100000:3.0:1780809610.100318:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769024 00000100:00100000:1.0:1780809610.100332:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3445:x1867312338768000:12345-0@lo:400:kworker.0 Request processed in 56us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809610.100338:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1780809610.100347:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1780809610.100347:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1780809610.100352:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768128 00000100:00100000:0.0:1780809610.100354:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1867312338768512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780809610.100362:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3445:x1867312338768384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809610.100366:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768128 00002000:00000024:0.0:1780809610.100368:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809610.100406:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1780809610.100414:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1867312338768512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809610.100415:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338768128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100418:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3445:x1867312338768384:12345-0@lo:400:kworker.0 Request processed in 58us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809610.100430:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809610.100436:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1780809610.100436:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1780809610.100452:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9caded24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338768768:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100463:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768256 00000100:00100000:2.0:1780809610.100464:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338768128:12345-0@lo:400:kworker.0 Request processed in 51us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809610.100468:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768256 00000100:00100000:2.0:1780809610.100479:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1780809610.100484:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1780809610.100489:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809610.100501:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768768 00000100:00100000:0.0:1780809610.100501:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338768896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100506:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1780809610.100507:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768768 00000100:00100000:1.0:1780809610.100514:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338769280:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100520:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338769024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809610.100529:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1780809610.100537:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338768768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809610.100558:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809610.100569:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338768896:12345-0@lo:400:kworker.0 Request processed in 73us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809610.100573:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338769024:12345-0@lo:400:kworker.0 Request processed in 54us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809610.100582:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1780809610.100584:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338768768:12345-0@lo:400:kworker.0 Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809610.100611:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1780809610.100616:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1780809610.100619:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338768384:0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100631:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1780809610.100641:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338768896:0@lo:400:kworker.0 00000100:00100000:2.0:1780809610.100642:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769408 00000100:00100000:0.0:1780809610.100645:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338768256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809610.100647:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769408 00000100:00100000:1.0:1780809610.100660:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3445:1867312338768000:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100666:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769536 00000100:00100000:3.0:1780809610.100671:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769536 00000100:00100000:2.0:1780809610.100674:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338768640 00000100:00100000:2.0:1780809610.100678:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338768640 00000100:00100000:1.0:1780809610.100697:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338768256:0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100697:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338768256:12345-0@lo:400:kworker.0 Request processed in 56us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809610.100704:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769152 00000100:00100000:2.0:1780809610.100704:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769664 00000100:00100000:2.0:1780809610.100709:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769664 00000100:00100000:3.0:1780809610.100710:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769152 00000100:00100000:1.0:1780809610.100714:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338768768:0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100719:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1780809610.100732:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769280 00000100:00100000:2.0:1780809610.100736:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769280 00000100:00100000:3.0:1780809610.100744:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1780809610.100755:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3445:x1867312338769408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809610.100760:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1780809610.100770:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1867312338769536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809610.100774:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1780809610.100800:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338768640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100818:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1780809610.100822:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1867312338769536:12345-0@lo:400:kworker.0 Request processed in 55us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809610.100831:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1780809610.100836:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3445:x1867312338769408:12345-0@lo:400:kworker.0 Request processed in 79us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809610.100837:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338769664:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1780809610.100845:0:3445:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc4ff1180 x1867312338769408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809610.100848:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1780809610.100857:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1780809610.100860:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338769152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809610.100869:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3445:1867312338769408:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100882:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1780809610.100895:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338769280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809610.100895:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338769664:12345-0@lo:400:kworker.0 Request processed in 63us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809610.100904:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338769152:12345-0@lo:400:kworker.0 Request processed in 46us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809610.100913:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1780809610.100919:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338768640:12345-0@lo:400:kworker.0 Request processed in 121us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809610.100920:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1780809610.100944:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1780809610.100949:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338769280:12345-0@lo:400:kworker.0 Request processed in 57us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809610.100954:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338768128:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.100958:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1780809610.100980:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338768640:0@lo:400:kworker.0 00000100:00100000:1.0:1780809610.100991:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadef0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338769280:0@lo:400:kworker.0 00000100:00080000:3.0:1780809610.100992:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780809610.100994:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338769152:0@lo:400:kworker.0 00000100:00080000:3.0:1780809610.100997:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780809610.101005:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1780809610.101014:0:3443:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc4ff2300 x1867312338769664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809610.101021:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338769664:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.101050:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9caded24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338769024:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.101064:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1867312338769536:0@lo:400:kworker.0 00000100:00100000:3.0:1780809610.101079:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc5e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338767744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780809610.101097:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338768512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780809610.611786:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338769792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780809610.611843:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809610.611897:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769792 00000100:00100000:2.0:1780809610.611906:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769792 00000100:00100000:2.0:1780809610.611957:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1780809610.611969:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338769792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780809610.612004:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:2.0:1780809610.612057:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338769792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809610.612065:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1780809610.612083:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338769792:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1780809610.612324:0:78218:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1780809610.803794:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780809611.123761:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338769920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780809611.123831:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809611.123874:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338769920 00000100:00100000:0.0:1780809611.123882:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338769920 00000100:00100000:0.0:1780809611.123925:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1780809611.123935:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338769920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780809611.123957:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:0.0:1780809611.123996:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338769920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809611.124001:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1780809611.124034:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338769920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809611.773830:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809611.773871:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809611.773877:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079552 00000100:00100000:0.0:1780809611.773887:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079552 00000100:00100000:1.0:1780809611.773897:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809611.773919:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079424 00000100:00100000:2.0:1780809611.773924:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079424 00000100:00100000:1.0:1780809611.773930:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809611.773955:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079680 00000100:00100000:0.0:1780809611.773959:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079680 00000100:00100000:2.0:1780809611.773969:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 395 00000100:00100000:3.0:1780809611.773970:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1129 00000100:00100000:2.0:1780809611.773985:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2393:x1867312335079424:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809611.773987:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2394:x1867312335079552:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809611.773992:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1130 00000100:00100000:1.0:1780809611.774001:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809611.774006:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2393:x1867312335079680:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809611.774062:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2393:x1867312335079680:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809611.774065:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2394:x1867312335079552:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809611.774065:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809611.774068:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2393:x1867312335079424:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809611.774078:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1130 00000100:00100000:2.0:1780809611.774083:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 395 00000100:00100000:3.0:1780809611.774086:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1129 00000100:00100000:0.0:1780809611.774093:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079936 00000100:00100000:0.0:1780809611.774097:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079936 00000100:00100000:3.0:1780809611.774108:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080064 00000100:00100000:3.0:1780809611.774113:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080064 00000100:00100000:0.0:1780809611.774124:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1131 00000100:00100000:0.0:1780809611.774131:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335079936:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:2.0:1780809611.774140:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780809611.774145:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809611.774147:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1132 00000100:00100000:2.0:1780809611.774156:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335079808 00000100:00100000:3.0:1780809611.774158:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312335080064:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809611.774161:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335079936:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 30us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809611.774162:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335079808 00000100:00100000:0.0:1780809611.774173:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1131 00000100:00100000:3.0:1780809611.774210:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312335080064:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809611.774215:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 679 00000100:00100000:3.0:1780809611.774224:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1132 00000100:00100000:2.0:1780809611.774229:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2394:x1867312335079808:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:3.0:1780809611.774259:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780809611.774266:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2394:x1867312335079808:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 41us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809611.774274:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 679 00010000:00010000:1.0:1780809611.827750:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809612.851777:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809613.875759:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809614.195726:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338770048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780809614.195804:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809614.195847:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770048 00000100:00100000:3.0:1780809614.195854:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770048 00000100:00100000:3.0:1780809614.195892:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1780809614.195901:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338770048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780809614.195930:0:77632:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1780809614.195973:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338770048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809614.195979:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1780809614.196026:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338770048:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1780809614.899774:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809615.219763:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338770176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780809615.219763:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfc960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338770560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780809615.219894:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338770432:0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.219895:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338770688:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.220639:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.220705:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338771072:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.220738:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.220772:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338771584:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.220801:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.220819:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc710f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338772096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809615.220842:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.220878:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770560 00000100:00100000:2.0:1780809615.220885:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770560 00000100:00080000:3.0:1780809615.220922:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780809615.220932:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772096 00000100:00100000:3.0:1780809615.220937:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.220938:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772096 00000100:00100000:3.0:1780809615.220958:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338770304:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.220962:0:80265:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770176 00000100:00100000:2.0:1780809615.220966:0:80265:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770176 00000100:00100000:3.0:1780809615.220986:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.220992:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1780809615.221004:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338770560:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809615.221012:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338770816:0@lo:400:kworker.0 00002000:00000024:2.0:1780809615.221035:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:3.0:1780809615.221059:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.221093:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338770560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809615.221098:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1780809615.221104:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338772096:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809615.221118:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00002000:00000024:3.0:1780809615.221126:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809615.221141:0:80265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1780809615.221151:0:80265:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338770176:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780809615.221156:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338772096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809615.221162:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00002000:00000024:2.0:1780809615.221164:0:80265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:3.0:1780809615.221188:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770816 00000100:00100000:3.0:1780809615.221192:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770816 00000100:00100000:2.0:1780809615.221202:0:80265:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1867312338770176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809615.221210:0:80265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1780809615.221216:0:78803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1780809615.221222:0:78803:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc2914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338770816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.221236:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771072 00000100:00100000:2.0:1780809615.221241:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771072 00000100:00100000:3.0:1780809615.221248:0:78803:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc2914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338770816:12345-0@lo:400:kworker.0 Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809615.221254:0:78803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1780809615.221275:0:77620:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770304 00000100:00100000:2.0:1780809615.221275:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1780809615.221279:0:77620:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770304 00000100:00100000:2.0:1780809615.221286:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338771072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809615.221302:0:77620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1780809615.221308:0:77620:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338770304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.221329:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc50e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338771072:12345-0@lo:400:kworker.0 Request processed in 43us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809615.221336:0:77620:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3443:x1867312338770304:12345-0@lo:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809615.221338:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1780809615.221345:0:77620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1780809615.221367:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771584 00000100:00100000:2.0:1780809615.221372:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771584 00000100:00080000:3.0:1780809615.221378:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780809615.221382:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780809615.221385:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780809615.221406:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1780809615.221415:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338771584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.221447:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1867312338771584:12345-0@lo:400:kworker.0 Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809615.221454:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1780809615.221498:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338771072:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.221513:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1867312338771584:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.221530:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc710f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338772096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809615.221560:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfc960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338770560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809615.221580:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338770816:0@lo:400:kworker.0 00000100:00100000:3.0:1780809615.221601:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338771328:0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.221703:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809615.221704:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809615.221722:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338771200:0@lo:400:kworker.0 00000100:00100000:0.0:1780809615.221728:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338770944:0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.221753:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809615.221759:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809615.221770:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338771712:0@lo:400:kworker.0 00000100:00100000:0.0:1780809615.221772:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338771456:0@lo:400:kworker.0 00000100:00100000:0.0:1780809615.221790:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809615.221799:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770688 00000100:00100000:1.0:1780809615.221802:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770688 00000100:00100000:0.0:1780809615.221807:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc710d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338771968:0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.221828:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771200 00000100:00100000:0.0:1780809615.221828:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809615.221831:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771200 00000100:00100000:1.0:1780809615.221847:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1780809615.221853:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338770688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809615.221853:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770944 00000100:00100000:0.0:1780809615.221856:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770944 00000100:00100000:0.0:1780809615.221875:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771456 00000100:00100000:0.0:1780809615.221877:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771456 00000100:00100000:1.0:1780809615.221882:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338770688:12345-0@lo:400:kworker.0 Request processed in 30us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809615.221888:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1780809615.221891:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771968 00000100:00100000:0.0:1780809615.221893:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771968 00000100:00100000:1.0:1780809615.221900:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1780809615.221906:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338771200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809615.221908:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1780809615.221913:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338770944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.221939:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc54ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338771200:12345-0@lo:400:kworker.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809615.221944:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338770432 00000100:00100000:1.0:1780809615.221945:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1780809615.221950:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338770944:12345-0@lo:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809615.221951:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338770432 00000100:00100000:0.0:1780809615.221959:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1780809615.221974:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1780809615.221982:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338771456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.221985:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1780809615.221994:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809615.221999:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc710ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338770432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809615.222022:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3444:x1867312338771456:12345-0@lo:400:kworker.0 Request processed in 41us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809615.222039:0:78803:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771328 00000100:00100000:3.0:1780809615.222043:0:78803:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771328 00000100:00100000:2.0:1780809615.222047:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc710ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338770432:12345-0@lo:400:kworker.0 Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809615.222055:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1780809615.222069:0:78803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1780809615.222077:0:78803:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338771328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809615.222107:0:78803:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338771328:12345-0@lo:400:kworker.0 Request processed in 32us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809615.222112:0:78803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1780809615.222153:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338771328:0@lo:400:kworker.0 00000100:00100000:3.0:1780809615.222160:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc710ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338771840:0@lo:400:kworker.0 00000100:00100000:3.0:1780809615.222186:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809615.222204:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338770176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780809615.222214:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3443:1867312338770304:0@lo:400:kworker.0 00000100:00100000:3.0:1780809615.222249:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771840 00000100:00100000:3.0:1780809615.222252:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771840 00000100:00100000:1.0:1780809615.222527:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1780809615.222533:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1780809615.222539:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338771968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.222550:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1780809615.222562:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338771840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.222607:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3444:x1867312338771968:12345-0@lo:400:kworker.0 Request processed in 50us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809615.222617:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1780809615.222626:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338770432:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.222635:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1867312338771840:12345-0@lo:400:kworker.0 Request processed in 75us (447us total) trans 0 rc 0/0 00000100:00080000:1.0:1780809615.222641:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780809615.222642:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338770944:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.222646:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00080000:1.0:1780809615.222648:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780809615.222653:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780809615.222660:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3444:1867312338771456:0@lo:400:kworker.0 00000100:00100000:0.0:1780809615.222670:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1780809615.222674:0:3444:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc710d880 x1867312338771968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780809615.222685:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc710d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3444:1867312338771968:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.222690:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc710ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1867312338771840:0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.222698:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338771712 00000100:00100000:0.0:1780809615.222708:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338770688:0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.222711:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338771712 00000100:00100000:0.0:1780809615.222722:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338771200:0@lo:400:kworker.0 00000100:00080000:3.0:1780809615.222751:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780809615.222768:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1780809615.222776:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338771712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809615.222819:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3442:x1867312338771712:12345-0@lo:400:kworker.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809615.222831:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00010000:00080000:0.0:1780809615.222849:0:3442:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc710c700 x1867312338771712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780809615.222857:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3442:1867312338771712:0@lo:400:kworker.0 00000100:00100000:2.0:1780809615.731768:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780809615.731791:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf60db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338772224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780809615.731851:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809615.731902:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772224 00000100:00100000:3.0:1780809615.731911:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772224 00000100:00100000:3.0:1780809615.731958:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1780809615.731967:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338772224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780809615.731997:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:3.0:1780809615.732038:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338772224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809615.732044:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1780809615.732082:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf60db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338772224:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780809615.923785:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1780809616.116156:0:77663:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1780809616.243754:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338772352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780809616.243810:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809616.243853:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772352 00000100:00100000:3.0:1780809616.243870:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772352 00000100:00100000:3.0:1780809616.243906:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1780809616.243916:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc710d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338772352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780809616.243938:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:3.0:1780809616.243991:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc710d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338772352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809616.243999:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1780809616.244037:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338772352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809616.894948:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809616.894983:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809616.895005:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809616.895007:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080192 00000100:00100000:2.0:1780809616.895016:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080192 00000100:00100000:1.0:1780809616.895030:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809616.895041:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080320 00000100:00100000:3.0:1780809616.895046:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080320 00000100:00100000:1.0:1780809616.895056:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809616.895056:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080448 00000100:00100000:0.0:1780809616.895064:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080448 00000100:00100000:2.0:1780809616.895081:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 397 00000100:00100000:1.0:1780809616.895090:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809616.895092:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080704 00000100:00100000:3.0:1780809616.895097:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080704 00000100:00100000:0.0:1780809616.895106:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080832 00000100:00100000:2.0:1780809616.895110:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2393:x1867312335080192:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809616.895112:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080832 00000100:00100000:1.0:1780809616.895116:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080576 00000100:00100000:1.0:1780809616.895121:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080576 00000100:00100000:3.0:1780809616.895125:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1139 00000100:00100000:3.0:1780809616.895134:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2394:x1867312335080320:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809616.895149:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1140 00000100:00100000:1.0:1780809616.895158:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 684 00000100:00100000:0.0:1780809616.895163:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2393:x1867312335080448:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809616.895171:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2394:x1867312335080576:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809616.895172:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2394:x1867312335080320:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809616.895181:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2393:x1867312335080192:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 66us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809616.895188:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1139 00000100:00100000:2.0:1780809616.895192:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 397 00000100:00100000:0.0:1780809616.895206:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2393:x1867312335080448:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809616.895209:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2394:x1867312335080576:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 41us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809616.895218:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1141 00000100:00100000:1.0:1780809616.895223:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 684 00000100:00100000:0.0:1780809616.895228:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1140 00000100:00100000:3.0:1780809616.895229:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335080704:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809616.895238:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1142 00000100:00100000:2.0:1780809616.895246:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312335080832:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809616.895262:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335080704:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809616.895267:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1141 00000100:00100000:2.0:1780809616.895284:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2394:x1867312335080832:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00080000:0.0:1780809616.895288:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780809616.895294:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1142 00000100:00080000:0.0:1780809616.895296:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780809616.895301:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1780809616.947744:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809617.971768:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809618.995705:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809619.315818:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338772480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780809619.315919:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809619.316080:0:78226:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772480 00000100:00100000:0.0:1780809619.316093:0:78226:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772480 00000100:00100000:0.0:1780809619.316163:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1780809619.316176:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338772480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780809619.316225:0:78226:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1780809619.316429:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338772480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 255us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809619.316482:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1780809619.316491:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338772480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1780809620.019781:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780809620.339768:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780809620.339779:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc710ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338772608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809620.339787:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338772736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780809620.339843:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809620.339843:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780809620.339857:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc5164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338772864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809620.339892:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadee57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3444:1867312338772992:0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.339894:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809620.339903:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338773120:0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.339926:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc7105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338773248:0@lo:400:kworker.0 00000100:00100000:2.0:1780809620.339933:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809620.339937:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809620.339963:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809620.339975:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc7105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338773504:0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.339981:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc7104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338773632:0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.339993:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc7107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3442:1867312338773760:0@lo:400:kworker.0 00000100:00100000:3.0:1780809620.339999:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772992 00000100:00100000:2.0:1780809620.340003:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809620.340019:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809620.340020:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772992 00000100:00100000:2.0:1780809620.340024:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3444:1867312338774016:0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.340026:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809620.340054:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1867312338774144:0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.340058:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3442:1867312338774272:0@lo:400:kworker.0 00000100:00100000:2.0:1780809620.340059:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809620.340067:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1780809620.340077:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3444:x1867312338772992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340093:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809620.340100:0:82719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772608 00000100:00100000:0.0:1780809620.340106:0:82719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772608 00000100:00100000:2.0:1780809620.340119:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338773504 00000100:00100000:2.0:1780809620.340123:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338773504 00000100:00100000:3.0:1780809620.340132:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3444:x1867312338772992:12345-0@lo:400:kworker.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809620.340139:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1780809620.340146:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338773120 00000100:00100000:1.0:1780809620.340150:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338773120 00000100:00100000:0.0:1780809620.340153:0:82719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772864 00000100:00100000:2.0:1780809620.340154:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338773760 00000100:00100000:2.0:1780809620.340158:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338773760 00000100:00100000:0.0:1780809620.340158:0:82719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772864 00000100:00100000:1.0:1780809620.340179:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338773632 00000100:00100000:1.0:1780809620.340182:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338773632 00000100:00100000:2.0:1780809620.340189:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774016 00000100:00100000:0.0:1780809620.340190:0:82719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1780809620.340197:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338773248 00000100:00100000:0.0:1780809620.340202:0:82719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338772608:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780809620.340203:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338773248 00000100:00100000:2.0:1780809620.340204:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774016 00000100:00100000:1.0:1780809620.340207:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1780809620.340218:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338773120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809620.340232:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774144 00002000:00000024:0.0:1780809620.340232:0:82719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809620.340236:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774144 00000100:00100000:3.0:1780809620.340242:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1780809620.340249:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338773248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340270:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338773120:12345-0@lo:400:kworker.0 Request processed in 53us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809620.340276:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1780809620.340281:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1780809620.340286:0:82719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338772608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809620.340291:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338773248:12345-0@lo:400:kworker.0 Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809620.340297:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf60db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338773504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.340299:0:82719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1780809620.340307:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1780809620.340309:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1780809620.340320:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338773632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.340323:0:82719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1780809620.340330:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809620.340337:0:82719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338772864:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809620.340339:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf60db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1867312338773504:12345-0@lo:400:kworker.0 Request processed in 48us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809620.340347:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1780809620.340352:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc7104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338773376:0@lo:400:kworker.0 00000100:00100000:2.0:1780809620.340368:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00002000:00000024:0.0:1780809620.340368:0:82719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:1.0:1780809620.340371:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338773632:12345-0@lo:400:kworker.0 Request processed in 53us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809620.340379:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3442:x1867312338773760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340384:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1780809620.340387:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809620.340404:0:82719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338772864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809620.340416:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338773376 00000100:00100000:3.0:1780809620.340417:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc7106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1867312338773888:0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340423:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338773376 00000100:00100000:2.0:1780809620.340424:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3442:x1867312338773760:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809620.340424:0:82719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1780809620.340431:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1780809620.340444:0:82719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338772736 00000100:00100000:0.0:1780809620.340447:0:82719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338772736 00000100:00100000:2.0:1780809620.340450:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1780809620.340453:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809620.340461:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3444:x1867312338774016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340467:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1780809620.340474:0:82719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1780809620.340479:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3443:x1867312338773376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.340485:0:82719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1867312338772736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780809620.340497:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3444:x1867312338774016:12345-0@lo:400:kworker.0 Request processed in 39us (441us total) trans 0 rc 0/0 00002000:00000024:0.0:1780809620.340498:0:82719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809620.340503:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1780809620.340517:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338773888 00000100:00100000:2.0:1780809620.340520:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338773888 00000100:00100000:3.0:1780809620.340532:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc7105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1867312338773504:0@lo:400:kworker.0 00000100:00100000:2.0:1780809620.340544:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1780809620.340546:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3443:x1867312338773376:12345-0@lo:400:kworker.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809620.340549:0:82719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1867312338772736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (218us total) trans 0 rc 0/0 00010000:00080000:3.0:1780809620.340553:0:3444:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadf574e680 x1867312338774016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780809620.340554:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1867312338774144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340562:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1780809620.340568:0:82719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1780809620.340575:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3444:1867312338774016:0@lo:400:kworker.0 00000100:00100000:3.0:1780809620.340606:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3444:1867312338772992:0@lo:400:kworker.0 00000100:00100000:2.0:1780809620.340614:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1867312338774144:12345-0@lo:400:kworker.0 Request processed in 60us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809620.340619:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1780809620.340624:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1780809620.340628:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1867312338773888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340635:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc7104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338773376:0@lo:400:kworker.0 00000100:00100000:1.0:1780809620.340657:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadee57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338772736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780809620.340669:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1867312338773888:12345-0@lo:400:kworker.0 Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00080000:2.0:1780809620.340675:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809620.340676:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00080000:2.0:1780809620.340678:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780809620.340681:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780809620.340684:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780809620.340686:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc7106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1867312338773888:0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.340715:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809620.340743:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc7104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338773632:0@lo:400:kworker.0 00000100:00100000:0.0:1780809620.340750:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc7105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338773248:0@lo:400:kworker.0 00000100:00100000:3.0:1780809620.340761:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774272 00000100:00100000:1.0:1780809620.340763:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1867312338774144:0@lo:400:kworker.0 00000100:00100000:3.0:1780809620.340765:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774272 00000100:00100000:0.0:1780809620.340775:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc5164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338772864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780809620.340784:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadfd793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338773120:0@lo:400:kworker.0 00000100:00100000:3.0:1780809620.340811:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1780809620.340812:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc710ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338772608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780809620.340813:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc7107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3442:1867312338773760:0@lo:400:kworker.0 00000100:00100000:3.0:1780809620.340820:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3442:x1867312338774272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809620.340862:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3442:x1867312338774272:12345-0@lo:400:kworker.0 Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809620.340867:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00010000:00080000:0.0:1780809620.340875:0:3442:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadf574d880 x1867312338774272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780809620.340885:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3442:1867312338774272:0@lo:400:kworker.0 00000100:00080000:3.0:1780809620.340890:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780809620.851743:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338774400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780809620.851813:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809620.851856:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774400 00000100:00100000:3.0:1780809620.851864:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774400 00000100:00100000:3.0:1780809620.851910:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1780809620.851921:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338774400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780809620.851957:0:77632:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:3.0:1780809620.852015:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9caded24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3443:x1867312338774400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809620.852023:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1780809620.852043:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3443:1867312338774400:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1780809620.852197:0:78218:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1780809621.043780:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780809621.363767:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338774528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780809621.363831:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809621.363875:0:78807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774528 00000100:00100000:2.0:1780809621.363883:0:78807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774528 00000100:00100000:2.0:1780809621.363927:0:78807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1780809621.363937:0:78807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadf574e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338774528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780809621.363958:0:78807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:2.0:1780809621.364002:0:78807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadf574e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338774528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809621.364010:0:78807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1780809621.364040:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338774528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809622.014759:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809622.014803:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809622.014817:0:77620:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335080960 00000100:00100000:0.0:1780809622.014833:0:77620:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335080960 00000100:00100000:1.0:1780809622.014845:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809622.014874:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081216 00000100:00100000:3.0:1780809622.014880:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081216 00000100:00100000:1.0:1780809622.014889:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809622.014900:0:77620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 399 00000100:00100000:2.0:1780809622.014906:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081472 00000100:00100000:2.0:1780809622.014912:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081472 00000100:00100000:0.0:1780809622.014914:0:77620:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2393:x1867312335080960:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1780809622.014923:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809622.014929:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081088 00000100:00100000:3.0:1780809622.014933:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081088 00000100:00100000:2.0:1780809622.014946:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1149 00000100:00100000:2.0:1780809622.014955:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2393:x1867312335081216:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809622.014967:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1150 00000100:00100000:3.0:1780809622.014977:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335081472:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809622.014991:0:77620:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2393:x1867312335080960:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809622.014992:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2393:x1867312335081216:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 36us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809622.015005:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1149 00000100:00100000:1.0:1780809622.015011:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809622.015011:0:77620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 399 00000100:00100000:3.0:1780809622.015016:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfd793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335081472:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809622.015023:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081600 00000100:00100000:3.0:1780809622.015027:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1150 00000100:00100000:2.0:1780809622.015027:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081600 00000100:00100000:2.0:1780809622.015051:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1151 00000100:00100000:3.0:1780809622.015059:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1152 00000100:00100000:2.0:1780809622.015060:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2393:x1867312335081088:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809622.015071:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335081600:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809622.015083:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2393:x1867312335081088:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809622.015089:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1151 00000100:00100000:0.0:1780809622.015102:0:79828:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081344 00000100:00100000:3.0:1780809622.015107:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2393:x1867312335081600:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 38us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809622.015107:0:79828:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081344 00000100:00100000:3.0:1780809622.015116:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1152 00000100:00080000:2.0:1780809622.015136:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780809622.015140:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780809622.015141:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780809622.015209:0:79828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 687 00000100:00100000:0.0:1780809622.015219:0:79828:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cae01b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2393:x1867312335081344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809622.015288:0:79828:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cae01b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2393:x1867312335081344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 71us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809622.015334:0:79828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 687 00010000:00010000:1.0:1780809622.067758:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809623.091735:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809624.115758:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780809624.435758:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338774656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780809624.435824:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809624.435872:0:77633:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774656 00000100:00100000:3.0:1780809624.435882:0:77633:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774656 00000100:00100000:3.0:1780809624.435941:0:77633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1780809624.435953:0:77633:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338774656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780809624.435988:0:77633:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1780809624.436045:0:77633:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338774656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809624.436053:0:77633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1780809624.436081:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338774656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1780809625.139763:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780809625.459777:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3442:1867312338775040:0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.459800:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338775168:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.459816:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338775296:0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.459859:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809625.459861:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809625.459866:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809625.459886:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775168 00000100:00100000:3.0:1780809625.459895:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775168 00000100:00100000:2.0:1780809625.459915:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338774784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780809625.459915:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338775680:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.459921:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338775808:0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.459944:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1780809625.459958:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338775168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.459962:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780809625.459966:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809625.459969:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809625.459990:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338776192:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.459997:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc5164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338774912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780809625.460002:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1867312338776320:0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.460015:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1867312338775168:12345-0@lo:400:kworker.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809625.460020:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1780809625.460037:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809625.460039:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775808 00000100:00100000:3.0:1780809625.460043:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775808 00000100:00100000:1.0:1780809625.460043:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809625.460068:0:78226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1780809625.460076:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338776704:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460077:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc5165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338775552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780809625.460081:0:78226:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338775808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.460086:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774784 00000100:00100000:3.0:1780809625.460090:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774784 00000100:00100000:3.0:1780809625.460124:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338774912 00000100:00100000:2.0:1780809625.460125:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780809625.460127:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809625.460128:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338774912 00000100:00100000:0.0:1780809625.460131:0:78226:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338775808:12345-0@lo:400:kworker.0 Request processed in 54us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809625.460138:0:78226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1780809625.460148:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775552 00000100:00100000:3.0:1780809625.460151:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775552 00000100:00100000:2.0:1780809625.460160:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338776064:0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.460170:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1867312338775168:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460171:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775296 00000100:00100000:0.0:1780809625.460177:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775296 00000100:00100000:2.0:1780809625.460190:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809625.460198:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1780809625.460209:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338774784:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780809625.460215:0:78805:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776064 00000100:00100000:2.0:1780809625.460216:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1867312338776576:0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.460219:0:77621:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775040 00000100:00100000:0.0:1780809625.460220:0:78805:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776064 00000100:00100000:1.0:1780809625.460225:0:77621:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775040 00002000:00000024:3.0:1780809625.460240:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:2.0:1780809625.460246:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809625.460249:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1780809625.460259:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338775296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.460262:0:77621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1780809625.460275:0:77621:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3442:x1867312338775040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460285:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775680 00000100:00100000:3.0:1780809625.460286:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3442:x1867312338774784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809625.460289:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775680 00000100:00100000:3.0:1780809625.460294:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1780809625.460300:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1867312338775296:12345-0@lo:400:kworker.0 Request processed in 44us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809625.460307:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1780809625.460315:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1780809625.460327:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338774912:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780809625.460328:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776192 00000100:00100000:1.0:1780809625.460328:0:77621:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3+23:3442:x1867312338775040:12345-0@lo:400:kworker.0 Request processed in 54us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809625.460333:0:78805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1780809625.460334:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776192 00000100:00100000:1.0:1780809625.460342:0:77621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00002000:00000024:3.0:1780809625.460344:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:0.0:1780809625.460347:0:78805:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338776064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460365:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776704 00000100:00100000:2.0:1780809625.460369:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776704 00000100:00100000:3.0:1780809625.460382:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338774912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809625.460382:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338775424:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460387:0:78805:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3442:x1867312338776064:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809625.460390:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776576 00000100:00100000:2.0:1780809625.460395:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776576 00000100:00100000:3.0:1780809625.460399:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1780809625.460400:0:78805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1780809625.460419:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809625.460423:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1780809625.460426:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1780809625.460435:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1867312338775552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780809625.460439:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338775680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.460444:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338775936:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460445:0:78806:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775424 00002000:00000024:3.0:1780809625.460446:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3566206976 avail 3564109824 00000100:00100000:0.0:1780809625.460450:0:78806:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775424 00000100:00100000:0.0:1780809625.460486:0:78806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1780809625.460489:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809625.460494:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1867312338775552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809625.460496:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1867312338775680:12345-0@lo:400:kworker.0 Request processed in 61us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809625.460498:0:78806:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef98e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3445:x1867312338775424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.460508:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3445:1867312338776448:0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.460511:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1780809625.460513:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1780809625.460537:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1780809625.460543:0:78806:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef98e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338775424:12345-0@lo:400:kworker.0 Request processed in 48us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809625.460548:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1780809625.460549:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338776192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780809625.460553:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809625.460560:0:78806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1780809625.460562:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338776704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460579:0:78806:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338775936 00000100:00100000:1.0:1780809625.460581:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338775424:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460583:0:78806:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338775936 00000100:00100000:0.0:1780809625.460629:0:78806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1780809625.460633:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3443:x1867312338776704:12345-0@lo:400:kworker.0 Request processed in 73us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809625.460641:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3443:x1867312338776192:12345-0@lo:400:kworker.0 Request processed in 95us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809625.460641:0:78806:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadef98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338775936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.460644:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1780809625.460657:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1867312338775680:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460658:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1780809625.460662:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776448 00000100:00100000:3.0:1780809625.460679:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776448 00000100:00100000:1.0:1780809625.460689:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3443:1867312338776192:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460693:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1780809625.460703:0:78806:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadef98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3445:x1867312338775936:12345-0@lo:400:kworker.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809625.460705:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1867312338776576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.460711:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00010000:00080000:1.0:1780809625.460713:0:3443:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadf574d880 x1867312338776704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780809625.460729:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3445:x1867312338776448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460738:0:78806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1780809625.460740:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1867312338776576:12345-0@lo:400:kworker.0 Request processed in 39us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809625.460742:0:3443:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3443:1867312338776704:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460747:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1780809625.460773:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3445:x1867312338776448:12345-0@lo:400:kworker.0 Request processed in 48us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809625.460779:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00080000:2.0:1780809625.460781:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780809625.460787:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780809625.460788:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780809625.460793:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780809625.460796:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780809625.460798:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776320 00000100:00100000:3.0:1780809625.460802:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776320 00000100:00100000:1.0:1780809625.460802:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3445:1867312338775936:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460824:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1867312338775296:0@lo:400:kworker.0 00010000:00080000:1.0:1780809625.460829:0:3445:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cadf574d500 x1867312338776448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780809641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780809625.460837:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1780809625.460844:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3445:1867312338776448:0@lo:400:kworker.0 00000100:00100000:0.0:1780809625.460850:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338775808:0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.460851:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1867312338776320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780809625.460853:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780809625.460891:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc5165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1867312338775552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780809625.460905:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1867312338776320:12345-0@lo:400:kworker.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1780809625.460912:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338776064:0@lo:400:kworker.0 00000100:00100000:3.0:1780809625.460913:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1780809625.460936:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1867312338776320:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460940:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1867312338776576:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460958:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:423cb5ef-9e0a-4eda-8cc0-0cf34e48eba3:3442:1867312338775040:0@lo:400:kworker.0 00000100:00100000:2.0:1780809625.460975:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338774784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780809625.460988:0:3442:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc5164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3442:1867312338774912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780809625.971781:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc4ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338776832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780809625.971856:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780809625.971896:0:77632:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776832 00000100:00100000:3.0:1780809625.971905:0:77632:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776832 00000100:00100000:3.0:1780809625.971955:0:77632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1780809625.971967:0:77632:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadee4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338776832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780809625.972003:0:77632:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261123072 avail 2259025920 00000100:00100000:3.0:1780809625.972054:0:77632:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadee4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3444:x1867312338776832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809625.972061:0:77632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1780809625.972097:0:3444:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cacc4ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3444:1867312338776832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780809626.163994:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1780809626.356331:0:77663:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1780809626.483834:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cadf574f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338776960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780809626.483908:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780809626.483958:0:78808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312338776960 00000100:00100000:0.0:1780809626.483965:0:78808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312338776960 00000100:00100000:0.0:1780809626.484064:0:78808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1780809626.484072:0:78808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338776960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780809626.484090:0:78808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3443523584 avail 3441426432 00000100:00100000:0.0:1780809626.484133:0:78808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1867312338776960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809626.484139:0:78808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1780809626.484205:0:3445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9cadf574f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1867312338776960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780809627.134915:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809627.134943:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809627.134963:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809627.134989:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1780809627.135011:0:77622:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081728 00000100:00100000:1.0:1780809627.135025:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809627.135033:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081984 00000100:00100000:0.0:1780809627.135038:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335082240 00000100:00100000:3.0:1780809627.135044:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081984 00000100:00100000:2.0:1780809627.135044:0:77622:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081728 00000100:00100000:0.0:1780809627.135050:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335082240 00000100:00100000:1.0:1780809627.135085:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809627.135118:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335082112 00000100:00100000:1.0:1780809627.135123:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335082112 00000100:00100000:2.0:1780809627.135125:0:77622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 401 00000100:00100000:2.0:1780809627.135140:0:77622:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadc8883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2391:x1867312335081728:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809627.135153:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335081856 00000100:00100000:3.0:1780809627.135160:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335081856 00000100:00100000:0.0:1780809627.135163:0:77629:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335082368 00000100:00100000:0.0:1780809627.135169:0:77629:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335082368 00000100:00100000:1.0:1780809627.135182:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 692 00000100:00100000:1.0:1780809627.135204:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335082112:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809627.135211:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1159 00000100:00100000:0.0:1780809627.135223:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1160 00000100:00100000:3.0:1780809627.135232:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312335081984:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809627.135240:0:77622:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadc8883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7020eb5f-d775-477e-a7d4-2140ed7d12b0+12:2391:x1867312335081728:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809627.135244:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335082240:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1780809627.135278:0:77622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 401 00000100:00100000:1.0:1780809627.135287:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+9:2391:x1867312335082112:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809627.135298:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2391:x1867312335081984:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 72us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809627.135306:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 692 00000100:00100000:0.0:1780809627.135310:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335082240:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 70us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809627.135330:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1159 00000100:00080000:2.0:1780809627.135331:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780809627.135339:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780809627.135344:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780809627.135347:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1160 00000100:00100000:3.0:1780809627.135358:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1161 00000100:00100000:3.0:1780809627.135370:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2391:x1867312335081856:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1780809627.135385:0:77629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1162 00000100:00100000:0.0:1780809627.135404:0:77629:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335082368:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1780809627.135415:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:2391:x1867312335081856:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 46us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809627.135426:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1161 00000100:00100000:0.0:1780809627.135450:0:77629:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b509e2d2-4082-4ca4-9485-25699a0a6c5b+5:2391:x1867312335082368:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 51us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1780809627.135457:0:77629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1162 00010000:00010000:1.0:1780809627.187723:0:77615:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780809628.211782:0:78604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780809628.346228:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809628.346278:0:80225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335082624 00000100:00100000:0.0:1780809628.346290:0:80225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335082624 00000100:00100000:0.0:1780809628.346345:0:80225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7673 00000100:00100000:0.0:1780809628.346354:0:80225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+18:144671:x1867312335082624:12345-192.168.203.33@tcp:101:touch.0 00010000:00010000:0.0:1780809628.346377:0:80225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780809628.346381:0:80225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1780809628.346409:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacd9926600/0x25b625638c8f264e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e31046871dc7 expref: 18 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.346441:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83c00) 00010000:00010000:0.0:1780809628.346451:0:80225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780809628.346466:0:80225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4c96 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726db expref: -99 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.346887:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.346903:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.346914:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.346937:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4ca4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.346945:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.346952:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780809628.347864:0:80225:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1ad:0x0], index 1: 0 00010000:00010000:0.0:1780809628.348120:0:80225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4cab lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348130:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4cab lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348139:0:80225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4cab lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348177:0:80225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348185:0:80225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348192:0:80225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348199:0:80225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc91cf800 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:0.0:1780809628.348203:0:80225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348220:0:80225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348228:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacc5b83700) 00010000:00010000:0.0:1780809628.348232:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780809628.348236:0:80225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348243:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cf800/0x25b625638c8f4c9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780809628.348262:0:80225:0:(mdt_handler.c:4481:mdt_save_lock()) ### save lock request 000000008312fc74 reply state 00000000b5395d2b transno 55834578880 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348272:0:80225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cee00/0x25b625638c8f4ca4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348278:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x62d802e7 (ffff9cacc5b83800) 00010000:00010000:0.0:1780809628.348281:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780809628.348283:0:80225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780809628.348308:0:80225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91cfe00/0x25b625638c8f4c96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726db expref: 20 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348327:0:80225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4cab lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726db expref: 19 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780809628.348336:0:80225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x85:0x0].0x0 (ffff9cacc5b83100) 00010000:00010000:0.0:1780809628.348338:0:80225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780809628.348341:0:80225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc91ce200, rc 0) 00000100:00100000:0.0:1780809628.348412:0:80225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:144671:x1867312335082624:12345-192.168.203.33@tcp:101:touch.0 Request processed in 2059us (2204us total) trans 55834578880 rc 0/0 00000100:00100000:0.0:1780809628.348421:0:80225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7673 00000100:00100000:2.0:1780809628.349675:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809628.349723:0:77628:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335082880 00000100:00100000:1.0:1780809628.349728:0:77628:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335082880 00000100:00100000:1.0:1780809628.349757:0:77628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7674 00000100:00100000:1.0:1780809628.349764:0:77628:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+20:144671:x1867312335082880:12345-192.168.203.33@tcp:36:touch.0 00010000:00010000:1.0:1780809628.349795:0:77628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780809628.349805:0:77628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc91ce200/0x25b625638c8f4cab lrc: 0/0,0 mode: --/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726db expref: 20 pid: 80225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.349817:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x85:0x0].0x0 (ffff9cacc5b83100) 00010000:00010000:1.0:1780809628.349822:0:77628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780809628.349843:0:77628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4cb9 lrc: 3/0,1 mode: --/PW res: [0x2000061c1:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.349850:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4cb9 lrc: 3/0,1 mode: PW/PW res: [0x2000061c1:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.349857:0:77628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4cb9 lrc: 3/0,1 mode: PW/PW res: [0x2000061c1:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780809628.349928:0:77628:0:(mdt_handler.c:4481:mdt_save_lock()) ### save lock request 000000002e1c08b9 reply state 00000000d20a9976 transno 55834578881 ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4cb9 lrc: 3/0,1 mode: PW/PW res: [0x2000061c1:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.349940:0:77628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65e00/0x25b625638c8f4cb9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000061c1:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.349946:0:77628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x85:0x0].0x0 (ffff9cadd479fc00) 00010000:00010000:1.0:1780809628.349949:0:77628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780809628.349951:0:77628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780809628.349999:0:77628:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:144671:x1867312335082880:12345-192.168.203.33@tcp:36:touch.0 Request processed in 234us (323us total) trans 55834578881 rc 0/0 00000100:00100000:1.0:1780809628.350006:0:77628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7674 00000100:00100000:1.0:1780809628.350538:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809628.350570:0:79214:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335083008 00000100:00100000:3.0:1780809628.350575:0:79214:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335083008 00000100:00100000:3.0:1780809628.350630:0:79214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7675 00000100:00100000:3.0:1780809628.350637:0:79214:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadfc413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+21:144671:x1867312335083008:12345-192.168.203.33@tcp:101:touch.0 00010000:00010000:3.0:1780809628.350658:0:79214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809628.350667:0:79214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4cc0 lrc: 2/0,0 mode: --/CR res: [0x2000061c1:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726e2 expref: -99 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.350691:0:79214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4cc0 lrc: 3/0,0 mode: CR/CR res: [0x2000061c1:0x85:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726e2 expref: 22 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.350699:0:79214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030800/0x25b625638c8f4cc0 lrc: 3/0,0 mode: CR/CR res: [0x2000061c1:0x85:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726e2 expref: 22 pid: 79214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.350713:0:79214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x85:0x0].0x0 (ffff9cadd479fc00) 00010000:00010000:3.0:1780809628.350715:0:79214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780809628.350717:0:79214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030800, rc 0) 00000100:00100000:3.0:1780809628.350742:0:79214:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadfc413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:144671:x1867312335083008:12345-192.168.203.33@tcp:101:touch.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809628.350754:0:79214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7675 00000100:00100000:0.0:1780809628.351537:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809628.351569:0:78806:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335083136 00000100:00100000:1.0:1780809628.351573:0:78806:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335083136 00000100:00100000:1.0:1780809628.351614:0:78806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 279 00000100:00100000:1.0:1780809628.351619:0:78806:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1867312335083136:12345-192.168.203.33@tcp:8:touch.0 00010000:00080000:1.0:1780809628.351655:0:78806:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from 645872a2-00b2-4cf6-9c95-e2d5667df9bf@192.168.203.33@tcp t0 exp 0000000000000000 cur 1890 last 0 00000020:00000080:1.0:1780809628.351680:0:78806:0:(genops.c:1406:class_connect()) connect: client 645872a2-00b2-4cf6-9c95-e2d5667df9bf, cookie 0x25b625638c8f4cc7 00002000:00100000:1.0:1780809628.351691:0:78806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 645872a2-00b2-4cf6-9c95-e2d5667df9bf/ffff9cacc8626800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113539 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780809628.351711:0:78806:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1780809628.351820:0:78806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1780809628.351844:0:78806:0:(import.c:65:import_set_state_nolock()) ffff9cacc8624800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780809628.351873:0:78806:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+6:2390:x1867312335083136:12345-192.168.203.33@tcp:8:touch.0 Request processed in 254us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809628.351878:0:78806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 279 00000100:00100000:2.0:1780809628.352440:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809628.352466:0:79836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335083264 00000100:00100000:0.0:1780809628.352470:0:79836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335083264 00000100:00080000:2.0:1780809628.352502:0:77623:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780809628.352506:0:79836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 280 00000100:00100000:0.0:1780809628.352513:0:79836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+6:0:x1867312335083264:12345-192.168.203.33@tcp:2:touch.0 00000001:00080000:0.0:1780809628.360016:0:8788:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 55834575019 is committed 00000001:00100000:0.0:1780809628.360029:0:8788:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 645872a2-00b2-4cf6-9c95-e2d5667df9bf 00000100:00100000:2.0:1780809628.360077:0:79836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:0:x1867312335083264:12345-192.168.203.33@tcp:2:touch.0 Request processed in 7561us (7632us total) trans 55834575019 rc 0/0 00000100:00100000:2.0:1780809628.360087:0:79836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 280 00000100:00100000:2.0:1780809628.360928:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1780809628.360958:0:80175:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335083520 00000100:00100000:0.0:1780809628.360965:0:80175:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335083520 00000100:00100000:0.0:1780809628.361004:0:80175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1926 00000100:00100000:0.0:1780809628.361013:0:80175:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+22:144671:x1867312335083520:12345-192.168.203.33@tcp:35:touch.0 00000100:00100000:0.0:1780809628.361260:0:80175:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:144671:x1867312335083520:12345-192.168.203.33@tcp:35:touch.0 Request processed in 247us (332us total) trans 55834578882 rc 0/0 00000100:00100000:0.0:1780809628.361268:0:80175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1926 00000100:00100000:0.0:1780809628.479974:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809628.480031:0:78216:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335083648 00000100:00100000:1.0:1780809628.480043:0:78216:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335083648 00000100:00100000:1.0:1780809628.480095:0:78216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7676 00000100:00100000:1.0:1780809628.480104:0:78216:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+23:141081:x1867312335083648:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1780809628.480130:0:78216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809628.480152:0:78216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726e9 expref: -99 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.480218:0:78216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4cd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.480231:0:78216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.480241:0:78216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780809628.480317:0:78216:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 10752 00000004:00200000:1.0:1780809628.480320:0:78216:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 71 stripe count 1 MDT count 2 00000004:00010000:1.0:1780809628.480342:0:78216:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 78216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.480362:0:78216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f65a00/0x25b625638c8f4cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726e9 expref: 25 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.480376:0:78216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadf5f64c00/0x25b625638c8f4cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726e9 expref: 24 pid: 78216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.480382:0:78216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cadd479ff00) 00010000:00010000:1.0:1780809628.480385:0:78216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780809628.480388:0:78216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64c00, rc 0) 00000100:00100000:1.0:1780809628.480442:0:78216:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cadff78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141081:x1867312335083648:12345-192.168.203.33@tcp:101:bash.0 Request processed in 340us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809628.480447:0:78216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7676 00000100:00100000:2.0:1780809628.481388:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1780809628.481432:0:77627:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335083776 00000100:00100000:3.0:1780809628.481438:0:77627:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335083776 00000100:00100000:3.0:1780809628.481465:0:77627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7677 00000100:00100000:3.0:1780809628.481470:0:77627:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+24:141081:x1867312335083776:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1780809628.481477:0:77627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780809628.481485:0:77627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4cdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726f0 expref: -99 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481512:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481520:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481525:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481532:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481536:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481540:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481631:0:77627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4cf1 lrc: 3/1,0 mode: --/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481662:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481667:0:77627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780809628.481687:0:77627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000061c1:0x85:0x0]: returning size 0 00000004:00200000:3.0:1780809628.481690:0:77627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780809628.481696:0:77627:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481703:0:77627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481709:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481714:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481719:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481723:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031a00 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809628.481726:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481731:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481737:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cadd479ff00) 00010000:00010000:3.0:1780809628.481745:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809628.481749:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481756:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031a00/0x25b625638c8f4ce3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481768:0:77627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481774:0:77627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481781:0:77627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481786:0:77627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cadc0031200 already unused, calling callback (ffffffffc1fca4f0) 00010000:00010000:3.0:1780809628.481789:0:77627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481793:0:77627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481798:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x62d802e7 (ffff9cacc5b83800) 00010000:00010000:3.0:1780809628.481800:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780809628.481802:0:77627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481806:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0031200/0x25b625638c8f4cea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x62d802e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481820:0:77627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030600/0x25b625638c8f4cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726f0 expref: 26 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481836:0:77627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cadc0030000/0x25b625638c8f4cf1 lrc: 3/0,0 mode: PR/PR res: [0x2000061c1:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726f0 expref: 25 pid: 77627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780809628.481841:0:77627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000061c1:0x85:0x0].0x0 (ffff9cadd479fc00) 00010000:00010000:3.0:1780809628.481842:0:77627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780809628.481844:0:77627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadc0030000, rc 0) 00000100:00100000:3.0:1780809628.481868:0:77627:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc4ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:645872a2-00b2-4cf6-9c95-e2d5667df9bf+25:141081:x1867312335083776:12345-192.168.203.33@tcp:101:bash.0 Request processed in 398us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1780809628.481872:0:77627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7677 00000100:00100000:2.0:1780809628.482961:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1780809628.482995:0:79470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1867312335083904 00000100:00100000:1.0:1780809628.482999:0:79470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1867312335083904 00000100:00100000:1.0:1780809628.483031:0:79470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 281 00000100:00100000:1.0:1780809628.483040:0:79470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc5164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+5:2393:x1867312335083904:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1780809628.483049:0:79470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780809628.483060:0:79470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007293ca8b/0x25b625638c8f4cf8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe54e310468726f7 expref: -99 pid: 79470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780809628.483083:0:79470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ad:0x0] initial LVB size: 0, mtime: 0x6a24ff9c, atime: 0x6a24ff9c, ctime: 0x6a24ff9c, blocks: 0x1 00010000:00010000:1.0:1780809628.483102:0:79470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780809628.483104:0:79470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780809628.483111:0:79470:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007293ca8b/0x25b625638c8f4cf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726f7 expref: 6 pid: 79470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.483123:0:79470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007293ca8b/0x25b625638c8f4cf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xfe54e310468726f7 expref: 6 pid: 79470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780809628.483131:0:79470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cadf5f64e00, rc 0) 00000100:00100000:1.0:1780809628.483154:0:79470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc5164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:645872a2-00b2-4cf6-9c95-e2d5667df9bf+6:2393:x1867312335083904:12345-192.168.203.33@tcp:101:bash.0 Request processed in 115us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1780809628.483159:0:79470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 281 00000001:02000400:1.0:1780809629.016841:0:83773:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_100: @@@@@@ FAIL: 1: write failed 00010000:00010000:2.0:1780809629.236699:0:77616:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 22554 lines, 22554 kept, 0 dropped, 0 bad.